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ABSTRACT 

The report contains an overall account of three 
annual evaluation studies (1971-73) of a project designed to 
demonstrate how four components supplemented the existing counseling 
system in the Pittsburgh Public Schools. The components providing 
occupational information were: (1) a career orientation program for 
sixth, seventh, and eighth grades; (2) a cooperative work experience 
program for secondary students enrolled in marketable skill-centered 
programs; (3) a placement program for high school graduates; and (4) 
Project SET (Select Employment Trainee), a counseling/training 
program for alienated potential high school drop-outs not enrolled in 
vocational programs. A summary describes each of the components and 
presents major conclusions of the three year evaluation reflecting 
the general success of the program. Other sections of the report 
provide descriptions of the interactive process used in evaluation, 
detailed descriptions of the program components, and the procedures 
used for each of the three evaluations. An in-depth discussion of the 
evaluation results (including tabulated achievement test scores and 
attitude data) is presented cumulatively by year for each project 
component, with emphasis on the third year. Appended are student, 
parent, and employer questionnaires for the project components, and a 
student achievement test for the career orientation program. 
>(Author/HS) 
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PREFACE AND ACKNOWLEDGMENTS 



In 1970, the American Institutes for Research (AIR) and the Pittsburgh 
School District contracted for the first of three evaluation studies of 
^'Selected Functional Components of a Vocational Counseling System for Urban 
Youth." This demonstration project, conducted by the Pittsburgh Board of 
Education's Occupational, Vocational S Technical Education Division, was 
created under the Provisions of Part D of the Vocational Educational Amend- 
ments of 1968* The project Is designed to demonstrate how these four com- 
ponents supplement the existing counseling system In the Pittsburgh Public 
Schools^ Each component provides occupational information at a given "check 
point" along an IndividuaTs educational continuum. These "check-points" 
Include: a Career Orientation Program for pre-adolescents ; a Cooperative 
Work Experience Program for secondary students enrolled in marketable skill- 
centered programs; a Placement Program for high school graduates; and a 
provision for a Counseling/Training Program to serve high school students 
who are not enrolled In vocational programs. Alternatives are presented for 
Increasing cooperation and participation in public education by community 
agencies such as Model Cities, private schools, and the business/industrial 
community. This project Implements an approach for relating vocational- 
technical education to flexible, comprehensive programming. 

The purpose of this report Is to present the results of the three 
evaluation studies conducted by AIR. Reports of the first two studies were 
submitted to the Pittsburgh School District In 1971 and 1972 respect ?vel y* 
This report contains an overall account of the three evaluation studies, 
with emphasis on the results of the third year evaluation. This report Is 
organized In the following manner. An overall summary consisting of major 
conclusions of the 3"year evaluation follows this preface. The report 
continues with descriptions of the Interactive process used to conduct this 
evaluation and some Illustrations of how the process functions. Section III 
follows with descriptions of each of the program components* Section IV 
describes the procedures used for each of the three evaluations* Included 
In this discussion will be an Identification of each year's evaluation 
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emphasis with the rationale for the specific focus. Section V of the 
report presents the results of the evaluation studies. These results will be 
discussed cumulatively by year by project component. For example, a summary 
of each year's evaluation results will be presented by component, followed 
by an In-depth discussion of the results of the third year evaluation. In 
so doing, the report will represent a comprehensive, self-contained document 
which will summarize the 3-year evaluation effort by AIR with a focus on the 
third year evaluation. 

Throughout this 3-year effort, various staff members from both the 
American Institutes for Research and the Pittsburgh Public Schools cooperated 
to produce an evaluation document useful for program modifications of the 
vocational counseling system. During the first evaluation AIR was repre- 
sented by Dr. Michael Rosenfeld, Dr. Jane Schubert, and Mr. Robert Coll-r'ns-, 
the second evaluation was conducted primarily by Dr. Rosenfeld and Dr. 
Schubert; the third evaluation has been directed by Dr. Schubert. During 
our working relationship with the Pittsburgh Public Schools, AIR received 
the competent and willing cooperation of representatives from the school 
district, particularly the Occupational, Vocational £ Technical Education 
Division. The individuals mentioned assisted in the planning, conducting 
and report preparation phases of these evaluations. Appreciation is acknowl- 
edged to the following Individuals for their support in arranging meetings 
with project managers and teachers, scheduling the testing In the representa- 
tive schools, supplying the necessary data for the program descriptions, and 
preliminary reviews of this and other reports: Ms. Rachael Brooks, 
Dr. Alma Evans, Dr. Nicholas Flannick, Mr. Al Markowski, Mr. Fred Monaco, 
Mr. John Pardlni, and Ms. Rose Smith. In addition, AIR would like to express 
sincere appreciation to the many school administrators, teachers, and stu- 
dents who participated in these studies during the past three years. 





Jane Gary Schubert 
Principal Investigator 
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I. SUMMARY 



The purpose of this evaluation study was to examine the demonstration 
project, "Selected Functional Components of a Vocational Counseling Syster 
for Urban Youth/' and, as a result of this assessment, Identify ways in 
which the ongoing efforts of this system might be strengthened. Three 
evaluation efforts have been conducted by AIR for the Pittsburgh School 
District; reports for the first two assessments were submitted in 1971 and 
1972. This report summarizes those two reports and presents the results of 
the third study. The demonstration project consists of four components: 
A Career Orientation Program for pre-adolescents; a Cooperative Vtork Experi- 
ence Program for secondary students enrolled in marketable skill-centered 
programs; a Placement program for high school graduates; and a Counseling/ 
Training Program which serves high school students who are not enrolled in 
vocational programs. Each of the three evaluations focused on specific 
components of this vocational counseling system. 

The interactive process of evaluation was used throughout the 3-year 
evaluation effort. This process applies the theory that the role of the 
evaluator and the perception of this role by the project staff can be a 
critical element In determining the success or failure of an experimental 
program. Support of this notion requires that the evaluation team and the 
project staff work together to determine project objectives, then develop 
the appropriate Instruments to measure those objectives. The results of 
the assessment can then be used to recommend program modifications. Evalua- 
tion can then be viewed as a positive element In the creation and refinement 
of experimental programs which strengthens these programs, rather than as a 
negative element whose purpose Is solely to Identify program weaknesses. During 
this evaluation, both project staff administrators and classroom teachers 
cooperated with AIR in clarifying specific component objectives, and 
submitting items which were used as the basis for the design of attitude 
and performance measures. The final Instruments were constructed by AIR 
and approved by the sponsor. 
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The following summary describes each of the componeuts of the vocational 
counseling program, Identifies which component received emphasis In each 
evaluation, ana presents the overall results of the 3-year effort. 

A> The Career Orientation Program 

1> Phase I — 6th Grade 

This Introduces the 3"-year exploratory experience of occupational educa- 
tion to students In the 6th grade. "Hands-on*' activities In the field of 
Human Relations, Production, Communications, and Economics provide the basis 
for program activities. Students meet for one 8o-mInute activity period 
per week. Program implementation began in March 1971. At that time, a team 
of three Itinerant teachers visited selected city schools which participated 
in the program. In 1971-72, 15 part'^-loating schools were serviced by a 
staff Increased from three (one itinerant team) to nine (three Itinerant 
teams). In 1972-73, 15 schools and 1,320 students received instruction. 
Of the nine itinerant teachers, three were assigned to the South Side Center. 
As of September 1973, the Itinerant team concept was discontinued and these 
teachers joined the Phase II and Phase III staffs at the Washington and 
South Side Education Centers. Phase I is now taught only at three middle 
schools. 

In 1971, the first evaluation reviewed the Phase I plans and reported 
the results of Interviews with the Itinerant team. Recommendations were 
made on the basis of that data. The final evaluation gathered attitude 
data from a small sample of Phase I students and parents. Phase I received 
major evaluation emphasis during the second study. Student performance 
data, student attitude data, classroom teacher and Itinerant teacher attitude 
data were collected. Overall, Phase I seemed to be operating smoothly. 
Student achievement scores Indicated that students were learning the desired 
material. The attitude measures administered during the second and third 
evaluations suggested that students liked the programs. 
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2. Phase ll"7th Grade 



This Is the second of the 3-year Career Orientation Program. Students 
Increase their participation to one-half day per week, traveling from their 
home schools to one of five education centers. The purpose of Phase I I Is 
to involve students further In "hands-on'' activities In ten vocational areas. 
These ten content areas represent various occupational careers which students 
may choose within the disciplines of Business Education, Home Economics, 
and Industrial Arts. In 1970-71, 1,635 students in the program were Instruc- 
ted by 15 teachers. In 1971-72, it was noted that enrollment increased to 
2,850, and the teaching staff had grown to 30. In the 1972-73 school year, 
2,736 students received Instruction in Phase II. By Movember 1973, the 
Phase 11 enrollment decreased to 2,623. 

Phase II received primary evaluation emphasis durinq the first evalua- 
tion. Students, teachers, and principals were sampled to receive Informa- 
tion regarding the program. However, each subsequent evaluation Included a 
minor emphasis on program operations and participant attitudes. The results 
of the studies showed that students generally performed well on the achieve- 
ment measures and that they liked the program. The first evaluation revealed 
that some students were not receiving Instruction In all ten areas; however, 
the circumstances causing this weakness were corrected. Now all students 
receive Instruction In all ten vocational areas. The teachers Indicated 
strong commitment to the program and Identified areas they considered weak. 
Since teachers were not sampled In the last study. It is not recorded 
whether their suggestions were used In recent proqram modi f Ication. Overall, 
Phase II seems to be functioning well and achieves one of its goals, to 
help students select four of the ten vocational areas which they would like 
to study In Phase I I 1. 

3. Phase III— 8th Grade 

The final year of the exploratory program consists of an in-depth 
exploration of vocational occupations in four related areas. The students 
choose the four areas from the ten to which they have been exposed In Phase 
II. Students and teachers make contracts which provide the framework for 
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the study of a specific content area. Students who participate In this 
phase also travel to the various education centers to receive Instruction 
one-half day per week. Upon completion of Phase III, students should be 
more equipped to select the type of curriculum he or she wishes to pursue 
In high school. Overall, the same* teachers who teach Phase II also teach 
Phase III, Their school day Is divided between providing Instruction to 
Phase II and Phase III students- Phase III was not Implemented during the 
first evaluation- In the 1971-72 school year, during the second study, ^5 
feeder schools sent 2,711 students to the OVT Centers. The third year 
evaluation study showed enrollment figures Increased to 3,2^7 students from 
^9 city schools. By November 1973, the enrollment dropped to 2,^93 students 
from 55 feeder schools. 

The third year evaluation focused on Phase III program operations. 
Attitude questionnaires had been administered to Phase III teachers during 
the second evaluation. The final year emphasized student performance and 
achievement. The results of the evaluation showed that students liked the 
program and generally did well- on the performance measure. Students also 
Indicated that participation in this program helped them choose a course of 
study for the next year. Student scores were not as high as one might 
expect for a program where students choose the subject areas In which they 
receive In-depth Instruction. Students correctly responded to approximately 
56 percent of the Items. If the studenf.s liked the program as much as their 
attitude scores seemed to Indicate, then It might be worthwhile Investigating 
why the performance scores were not higher. 

B. Graduate Placement and Cooperative Work Experience Programs 

The overall goals of Graduate Placement and Cooperative Work Experience 
(coop) are quite similar. The Placement Program attempts to find employment 
for graduating seniors or locate situations in which high school seniors 
become apprentices In particular trades. The COOP program Is designed to 
provide work experience during the senior year while the student complet'i 
academic and vocational requirements for graduation. The COOP program 
currently serves students primarily enrolled In skill-centered programs. 
Responsibility for all student placement rests with ten centrally-based 



work experience coordinators who are supported on a part-time basis by ten 
school-based coordinators who also serve as distributive education teachers. 
Both of these components are integral parts of a broader system of counseling 
which Includes testing and guidance, the instructional process, and other 
school and work-related experiences. 

The 1971 evaluation study conducted by AIR focused most prominently on 
this segment of the overall vocational counseling program. At that time, 
attitude measures and/or personal Interviews were used to collect data from 
every level of program participant. Employers of students, graduates who 
received placement, coordinators, and students were Included In the evalua- 
tion. The results suggested that both programs were well conceived and well 
administered with a positive and open attitude by the staff toward continuous 
updating. The second evaluation study reviewed ongoing procedures and pro- 
gram operations. This review again revealed that the programs were operating 
efficiently and effectively. A new feature to the overall program was the 
addition of a job center In each of five Pittsburgh Schools. These job 
centers attempt to find jobs for students in the inner-city who are not 
continuing their formal education beyond high school. On-site recruiting of 
students by employers occurred In the job center rather than In the occupa- 
tional setting. 

The third evaluation gathered attitude data by submitting questionnaires 
to students In the p r 09 rants, ^and employers of students in the programs. 
Overall, the students appear to benefit from their work experience program. 
Employers Indicate that students from the program ore capable of joining 
an occupational environment, with no outstanding problem areas. In addition, 
the job centers located In selected high schools increased from 5 to 13. 

C. Project SET (Select Employment Trainee) 

Project SET Identifies disadvantaged alienated students who are 
potential secondary school drop-outs, and provides them with counseling, 
occupational exploration, and training opportunities that will enable them 
to develop a marketable skill while creating positive attitudes toward 
education and work. Staff members of this component cooperate with other 
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placement agencies In the school system to provide opportunities for these 
students to learn about the world of work while meeting pragmatic economic 
and educational necessities. Staff members work closely with private 
Industries and government agencies to supply these alienated youth with 
counseling and career exploration and training experiences. As of July 1973, 
Project SET became part of an expanded program entitled, *'Cooperat 1 ve Work 
Study Program for Disadvantaged Urban Youth." 

The first evaluation conducted by AIR reviewed the developmental plan 
of Project SET and offered suggestions to the staff. Increased emphasis 
occurred in the second evaluation by administering attitude questionnaires 
to a sample of Project SET students, employers of students, parents, and 
the entire Project SET staff. The results suggested that the program was 
substantively strong— student attitudes toward the program seemed very 
positive. They enjoyed and benefited from the opportunity to work and to 
earn money while continuing their education. Although the percentage of 
return from the parents was small, those who did respond stated that they 
felt very positively about the program. The features they liked correlated 
with the features mentioned by students — namely that students could work 
to gain experience and earn nx)ney without sacrificing their formal education. 
Approximately 90 percent of the employers were interviewed by phone; overall, 
their responses suggested that the staff had been successful in communica- 
ting to the employers the needs of the students and the goals of the pro- 
gram. The employers reflected a positive and cooperative attitude toward 
helping these alienated students receive some assistance In finding meaning- 
ful opportunities In career exploration and experience. 

Less emphasis was placed on Project SET during the third and final 
evaluation. Questionnaires were administered to a sample of students and 
employers of students. Again, the responses indicated a general satisfac- 
tion with the program. No distinct patterns or changes were noted. 



ERIC 



IS 



II. EVALUATION METHOD 



A. Program Evaluation 

Flanagan (1969) In Educational Evaluation; New Roles, New Means , pro- 
poses a framework to assess the degree to which innovative educational treat- 
ments succeed In achieving their desired outcomes. His points focus on the 
need for: 

• Clear specifications of project objectives. These objectives 
must reflect the behavioral changes desired In students. 

• Program characteristics designed In such a way as to stimulate 
or originate the desired student outcomes. 

• Program evaluation composed of both formative and summatlve stages. 
The formative stage assesses the degree to which each of the program 
components Is operational and achieving its desired goals. This 

* phase of evaluation assesses the degree to which the treatment 
aspects of the project are functioning as defined In the proposal 
or by the project manager. The summatlve stage Involves the overall 
evaluation of program success. This evaluation normally takes place 
at the termination of the project. It Includes measures of student 
performance as well as Indices of the degree of Implementation of 
project treatment components. 

• Dynamic educational programs. In order to succeed, programs should 
contain mechanisms for change and Improvement based on a continuous 
flow of data regarding the effectiveness of a given program at 
achieving a specified set of objectives. 
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B. The Interactive Process of Evaluation 



In evaluating programs, the role of the evaluator has often been per- 
ceived In negative ways. Those most closely associated with the program 
frequently assume that an evaluation Is to be conducted for the purpose of 
evaluating the personnel rather than the program Itself. The existence of 
this attitude frequently makes It quite difficult to gather useful data on 
which to base recommendations for program change. 

AIR supports the notion that the role played by an evaluator and the 
perception of this role by the project staff can be a critical factor In 
determining the success or failure of an experimental program. The 
efficiency and usefulness of the evaluator are maximized when functioning 
as a colleague anxious to help the program succeed rather than merely Iden- 
tifying and amplifying weaknesses which document failure. An evaluation of 
a program, particularly an experimental program In Its early Implementation 
stages, Is not helpful If It stresses negative factors rather than providing 
data which can be used as a basis for appropriate changes necessary to achieve 
ine program objectives. In order to help a program succeed, an evaluator 
can: (1) develop procedures for objectively determining the degree to which 
stated objectives are achieved, and (2) provide recommendations for Improving 
project performance during the continuation of the project. The technique 
employed to achieve the objectives of this evaluation Is the Interactive 
process of evaluation. In this process, project staff members, such as 
classroom teachers, work together with the evaluation team In defining 
behavioral objectives of the program and developing the Items which measure 
student achievement of those objectives. 

The Interactive process occurs at various levels of project staffing. 
During each of the three studies, the AIR evaluation team maintained continual 
contact with the project monitor to maintain awareness of project activities 
and discuss all materials used. Also, the development of the instruments was 
a joint effort by the evaluation team and the project teachers. For example, 
during an In-service meeting, the teachers received a copy of the revised 
behavioral objectives for each of the ten subject areas In Phase 11 of the 
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Career Orientation Program. They were asked to prepare at least two Items 
which would measure one behavioral objective In the area they had taught. 
Each teacher was assigned two such objectives and thus was required to 
write no more than four Items. Upon submission, these Items were reviewed 
by a panel of teachers representing the Career Orientation education 
centers. The panel selected the Items which most appropriately reflected 
the Instruction In the centers. Upon completion of this. task, the evalua- 
tion team edited Items and then constructed the final Instrument. 

By cooperating on the development of the evaluation Instruments: (1) 
the test reflected the content of Instruction In the program; (2) students 
were tested on what they had been taught, rather than on what someone 
thought they had been taught; (3) student performance could be examined In 
light of program objectives; (^) the people on whom the primary responslbll 
ity for Implementation rests played a direct role In assessing the strength 
and weaknesses of the program; and (5) the evaluator acted as a consultant 
to help project staff learn some techniques of evaluation. In this way, 
the evaluation process becomes an aid to program modification. 



^ 3 

18 



III. PROGRAM DESCRIPTIONS 



A> Career Orientation Program 

The Career Orientation Program Is a 3-phase program. Phase I (6th 
Grade) Is an exploratory experience In which the students are exposed to 
four major concepts relating to the ''world of work**: Human Relationships 
(personal development); Production; Communications; and Economics 
(consume rsh I p) . 

In Phase II (7th Grade) the students gain actual experience In ten OVT 
areas with further reinforcement of the broad concepts of the "world of 
work" Identified above. This phase also enables students to organize, 
manage, and operate a company as they explore the ten content areas. 

Phase ill (8th Grade) constitutes an opportunity to select from two to 
four subject areas from the ten areas explored In Phase II. In-depth explor- 
ation and Individualized Instruction Is emphasized at this level. 

I . Phase l"6th Grade 

The purpose of the Phase I Career Orientation Program Is to Introduce 
the exploratory experience of occupational education to students In the 6th 
grade. "Hands-on" activities within the field of Human Relations, Produc- 
tion, Communications, and Economics provide the basis for curriculum devel- 
opment and selection. 

Actual program Implementation began In March 1971. At that time, three 
Itinerant teachers were assigned to coordinate activities In Business, Home 
Economics, and Industrial Arts which were used as the vehicles for Intro- 
ducing the previously Identified concepts to 6th graders In selected city 
schools. During the 1971-72 school year the number of Itinerant teachers was 
expanded In order to staff three teams, each comprised of three teachers. 
These three teams servl ces 15 city s choo Is In the 1 97 1 "72 school yea r • 
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One of the primary goals of the Phase I program was to coordinate the 
Career Orientation activities with the academic program. Both Career 
Orientation teachers and academic teachers met regularly to exchange Infor- 
mation regarding curriculum plans. The Phase I activities Included the 
content of these plans when possible; for example, If students were learning 
how to use a typewriter, they might practice typing some of their spelling 
words. 

Each team of Itinerant teachers visited two or more schools per day 
where they conducted an 80-mlnute class session. During this time, the 
teachers supervised hands-on activities by students; In the early Implemen- 
tation stages of the program, these production activities extended over a 
period of weeks. As a result of the first year's evaluative Inputs from 
teachers and students, the program was irodlfled to limit the production of 
an Item to no more than two class sessions. Each school, except Columbus, 
was visited by one Itinerant team once a week. Columbus was visited four 
times each week. 

Class sessions were conducted In a room especially set aside for use by 
the Itinerant team. Class sizes ranged from 20 to 60 students. In some 
cases, the academic classroom teachers stayed with the class during the 80- 
minute session. Initially, a working model of the Phase I curriculum. 
Implemented In the Chatham School In 1968, provided a basis for the activi- 
ties planned by the Itinerant teams. Following the first full year of 
Implementation (1970-71), teachers revised the curriculum based on their 
classroom experiences. In 1971-72, the number of itinerant teachers 
Increased to nine; these nine teachers comprised three teams who serviced 
city schools. In 1972-73, one team, or three of the nine itinerant teachers, 
was assigned to teach Phase II and Phase I I I at the South Side Education 
Center, As of September 1973, the Itinerant team concept was discontinued. 
Phase I now services students only In the middle schools. Arsenal, Columbus, 
and McNaugher. Four of the Itinerant teachers, now assigned to the 
Washington Education Center, teach Phase II and Phase III. Two members of 
the Itinerant team also joined the teaching staff of Phase II and Phase III 
at the South Side Education Center. 
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2. Phase I |-7th Grade 



Career Orientation students In the 7th grade originate from feeder 
schools and are assigned to one of five locations--the South Side Education 
Center, the Washington Education Center, Oliver and Columbus Middle School, 
Arsenal Middle School and McNaugher School. Each student attends one half- 
day Career Orientation session per week. The purpose of Phase II is to 
Involve students In '*hands-on*' activities in ten vocational areas. These 
exploratory introductions provide students with a body of knowledge and 
experience with which they can narrow their selection for further exploratory 
experiences in Phase III— the 8th grade. The ten content areas represent 
various occupational careers which people may choose within the disciplines 
of Business Education, Home Economics, and Industrial Arts. These ten 
content areas are: 

Business Education Home Economics Industrial Arts 

Business Communications Foods and Nutrition Manufacturing 
Merchandising Clothing and Textiles Power and Transportation 

Information Processing Community Services Construction 

V i s ua 1 Commun i cat 1 ons 

OVT exploratory programming is guided by teachers and paraprofessionals 
who work in teams to organize and supervise activities In each of the content 
areas. A secondary purpose for selecting particular content areas and 
creating the conceptual scheme previously defined is to have students partici- 
pate in as many activities as possible within each content area, and in so 
doing, create products which will be sold In a retailing activity called a 
merchandise mart. The mart represents the culmination of a business activity 
and provides an opportunity for students to purchase the items which they 
and their colleagues have been producing. The year's activities are coordi- 
nated and set up on the basis of a business venture as related to the world 
of work. According to the concept, each discipline will serve the following 
functions: 
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Dlsclpl Ines Function 

Business Education Business 

Industrial Arts — Production and Service 

Home Economics — Production and Service 



For example, the Business Department may set up a business on the basis 
of goods to be retailed — then handle all functions such as Business Communi- 
cations, Merchandising, and Information Processing required to handle the 
business activities. Examples of potential business simulations are a 
boutique shop, a Jewelry store, etc. 

In order to efficiently organize the exploratory program In the manner 
previously described, teachers In each center are assigned to work In teams. 
Three teams, each consisting of one teacher from each of the three major 
disciplines, form a self-contained unit which relates to the areas In which 
they are working. Sixty to seventy-five students are assigned to one team 
and receive Instruction In company-related activities within each of the 
ten areas from the three teachers to whom they have been assigned. 

An example of team functioning might be: a team can be assigned to the 
areas of Home Economics (Foods and Nutrition), Industrial Arts (Manufacturing), 
and Business Education (Information Processing). Activity coordination wl th In 
a team apportions responsibility for setting up an office to the Business Edu- 
cation component. The Manufacturing Lab produces the goods, with students 
performing tasks wUhln the business such as quality control specialists, 
payroll clerks, or shipping clerks, etc. The Foods and Nutrition teacher 
establishes a cafeteria to serve the workers dn the team. Items are mass 
produced rather than Individually constructed. Within each area, a wage 
scale is set up for each Job classification; students receive pay according 
to the tasks performed. The currency consists of either script or tokens 
which are used for purchasing Items in a retailing activity or the cafeteria. 



The conceptual framework of a business supplies a series of opportunities 
for all students to explore the ten areas related to the three major disci- 
plines. At the conclusion of the year, each student is requested to select 
two or four of the ten areas which he or she desires to explore In the 
continuation of the Career Orientation Program — Phase III In the 8th grade. 



The enrollment figures for Phase II for the3-y.ear period are as follows. The 
first study reported a total of 1,635 students who received Phase il Instruc- 
tion at two OVT Centers during the 1970-71 school year; the second study 
showed an Increase to 2,850 students In the 1971-72 school year; the third 
study reflected an enrollment of 2,736 students In the 1972-73 school year. 
As of November 1973, the enrollment dropped to a total of 2,623 from 55 
feeder schools to 5 OVT Centers. 

3. Phase 1 1 1— 8th Grade 

The Phase lll--8th grade curriculum outlines more In-depth experiences 
of the "world of work** activities to which the students were first Intro- 
duced In Phase II— 7th grade. Emphasis Is placed on processes basic to 
specific job activities found within the areas of Business Education, Home 
Economics, and Industrial Arts. Students are able to associate. Integrate, 
and catalog these basic processes with specific job roles or careers ranging 
from entry level jobs to administrative positions. The educational goal of 
the experiences is the adaptation of this knowledge to future decision 
making by the students. 

Students, functioning as members of large or small groups, or Individ- 
ually, are encouraged to develop greater inquiry abilities and participate 
in more specific activities, experiments, and projects. Student activities 
are realistic, interdisciplinary, and personal in nature. This program 
incorporates individualized instruction through the development of learning 
activity packages, which allows students to work at a pace that Is challenging, 
but achievable. Each learning activity package or teacher-student contract 
contains the purpose of the program of study, specific currlcular objectives, 
sample evaluation questions, and activities and the resources available for 
exploration of the selected area, e.g. manufacturing. If a student decides 
to terminate a contract, a new contract must be drawn up. This process is 
not designed to allow the student to casually make or break contracts; a 
contract can only be broken for good reason. During the 1971-72 school year, 
the Phase III curriculum was organized within the contract system Into self- 
contained modules which could be implemented by the teacher within his or 
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her specialized area. The time period spent by each student within that 
discipline varied according to the student's preference. 

The following list Identifies the specific tasks of each of the ten 
content areas of the three academic disciplines. 

Specific Task of Each Area: 

• Business Gommunlcatlons--handles all business affairs of corpora- 
tions. 

* 

• Information Provtess 1 ng~responslble for processing Invoices, filing 
records, bookkeeping, etc. 

• Merchandising— handles aidvertlslng and retailing services of the 
corporation. 

• Clothing and Textiles, Manufacturing and Construction— product Ion 
of goods. 

• Visual Communications— responsible for producing signs, doing 
lay-out and copy work, printing needed materials; may also produce 
a product such as silk screening job or engraved tags. 

• Power and Transportation— functions as the repair center. 

• Health and Community Services—set up a health clinic to handle 
physical examinations of all the workers, maintain health records, 
operate flrst-ald area, provide public health and nutritional 
Information to the workers, set up a model '*Chlld Care'' center, 
relate cosmetology as a service via grooming clinic, beauty or 
barber shop. 

• Foods and Nutr 1 tlon— wou Id handle the food production by setting 
up a cafeteria or short-order shop to feed classes on a rotating 
basis. Students would pay for meals with money earned. 

Forty-five feeder schools sent 2,711 students to the OVT Centers In the 
1971-72 school year. During the 1972-73 school year, forty-nine schools 
contributed 3,2^7 students to Phase Ilk Fifty-five feeder schools sent 
2,^93 students to Phase III program as of November 1973. 

124 
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B. Graduate Placement and Cooperative Work Experience 



The Pittsburgh Board of Public Education recognizes student placement 
as a logical component of the educational process. Employment Is viewed as 
an Integral component of education because It assists students to become 
participating and productive members of our society and economy. The varied 
placement programs described here reflect AIR's understanding of the broad 
range of employment-related student needs. 

Although their specific objectives differ, the overall objectives of 
Graduate Placement and Cooperative Work Experience (COOP) are linked. The 
Graduate Placement program attempts to find employment for graduating seniors 
or locate situations In which students become apprentices in particular 
trades. The COOP program Is designed to provide work experience during the 
senior year while the student completes the academic and vocational require- 
ments for graduation. Following graduation, students often remain In the 
same job they had during their work experience. The Pittsburgh COOP program 
has been expanded to serve both those students enrolled In skill centered 
programs and those who enrolled In non-skill centered programs (Project SET). 

Primary responsibility for all student placement rests with ten Centrally- 
Based Coordinators. They are supported, on a part-time basis by ten School- 
Based Coordinators, who are Distributive Education teachers. They are further 
assisted by 15 work experience coordinators assigned to specialized placement 
programs designed to serve specific student populations. 

In the performance of the placement function there exists a continuing 
relationship between the work experience coordinators and school counselors, 
as well as with teacners. This is essential In order for placement staff 
to have sufficient Information necessary to assist a student In his or her 
transition from the classroom to the world of work. 
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I. Full-time Placement 



The staff consists of central coordinators and supporting staff who 

serve graduates Interested In career employment and drop-outs of working 
age. 

2. Part-"tlme Employment 

The staff consists of central coordinators and supporting staff who 
provide placement assistance available to any student of working age regard- 
]ess of his or her area of study. Credit Is not awarded for such experience. 

3* Cooperative Work Experience "A" 

The staff consists of central coordinators and school based coordinators. 
Cooperative Work Experience "A** Is a part-time, supervised employment, related 
to a high school senior's skill training. Grades are assigned and credit 
Is awarded for successful v/ork experience. Students are paid by employers at 
entry level rates. This program offers the student an opportunity to practice 
and enhance his or her learned skills. In addition, she/he Is exposed to the 
Industrial requirements of production and distribution which often are 
difficult to simulate In the classroom. 

C. Project SET (Select Employment Trainee) 

1. Purpose of the Program 

The purpose of Project SET Is to Identify disadvantaged alienated 
students who are potential secondary school drop-outs, and provide them 
with counseling, exploration and training opportunities that will enable 
them to develop a marketable skill while creating positive attitudes toward 
education and work. 
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General Objectives: 

• To provide disadvantaged alienated students with skills which will 
enable them, upon completion of their secondary education, to go 
on to further education or obtain a job In the private sector. 

• To demonstrate that the private sector, local school systems, and 
government agencies can effectively coordinate their Individual 
efforts In providing alienated youth with meaningful counseling, 
career exploration and training experiences and to develop Innova- 
tive program models for these experiences. 

• To help disadvantaged alienated students achieve positive work 
experiences while they continue formal education and training to 
prepare for the world of work. 

Counse 1 Ing: 

• To Identify student attitudes toward education and work. 

• To Identify the students* Interests and capabilities, then use them 
as a basis of counseling In determining training and career explor- 
ation potential • 

• To provide supportive counseling in an attempt to develop positive 
atti tudes toward work. 



Pre-Job Training: 

• To develop an open, non-structured participation program which 
utilizes fllmstrlps, movies, tapes, and role-play activities to 
provide experiences In potential b»npl oyer-employee situations. 

• To explore careers Identified as relevant to student Interests. 



19 

;o7 



IV. ANNUAL PROCEDURES 



Each of the three evaluation studies conducted for the Pittsburgh School 
District has focused on a different component of the vocational counseling 
program. The nature of each evaluation was determined by the level of funding 
for the annual effort, the degree of Implementation of each program component, 
and the extent to which each component had been evaluated by AIR during one 
of these three studies. Therefore, prior to each evaluation study, the AIR 
evaluation team and members of the Pittsburgh Public Schools project staff 
agreed on the selected elements which would be evaluated that year. The 
following section specifies the focus for each of the evaluation studies. 



A. 1971 

Major emphasis was placed on the program components which were most 
operational. Therefore, Phase II of the Career Orientation program, and 
the COOP and Graduate Placement programs received attention. Less emphasis 
was placed on Phase I of the Career Orientation program and Project SET. 
Evaluation design for this study consisted of: 

1. Career Orientation 

• Administration of an attitude questionnaire to the Phase I 
Itinerant team. 

• Classroom observations. 

• A meeting between the Itinerant team and one member of the evalua- 
tion team. 

• Administration of a performance measure to a 23 percent sample of 
Phase i I students. 

• Administration of an attitude measure to a 23 percent sample of 
Phase I i students. 



• Administration of an attitude measure to all Phase 11 teachers, 

• Administration of an attitude measure to both principals In the 
OVT Centers. 



2. Graduate Placement and COOP 

• Administration of an attitude measure to employers of COOP students 
and graduates, 

• Personal Interviews with central coordinators In the placement 
center. 

• Administration of attitude measures to a sample of students. 

3t Project SET 

• A review of developmental plans of Project SET. 



B. 1972 

Again, major emphasis was placed on the most operational program com- 
ponents. This year, the evaluation focused on Phase I and Phase M of the 
Career Orientation program and Project SET. Less emphasis was placed on 
Phase III and the COOP and Graduate Placement programs. Evaluation design 
for this study consisted of: 

1 . Career Orientation 

• Administration of a performance measure to a 22 percent sample of 
Phase I students. 

• Administration of an attitude measure to a 22 percent sample of 
Phase I students. 

• Administration of an attitude measure to Phase I classroom 
teachers. 

• Administration of an attitude measure to all nine Phase I Itinerant 
team members. 
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• Administration of a performance measure to an 11 percent sample of 
Phase I I students. 

• Administration of an attitude measure to an 1 1 percent sample of 
Phase I I students. 

• Administration of an attitude measure to all 30 Phase II teachers. 

• Administration of an attitude measure to all 30 Phase III teachers. 

2. Graduate Placement and COOP 

• Preparation of a review and summary of Graduate Placement and 
COOP programs. 

3* Project SET 

• Administration of an attitude measure to a sample of Project SET 
students • 

• Administration of an attitude measure to all Project SET staff. 

• Telephone Interviews with Project SET employers. 

• Administration of an attitude questionnaire to a sample of Project 
SET parents . 

C. 1973 



The third evaluation study focused on Phase III of the Career Orienta- 
tion program with less emphasis being placed on Phase I and Phase II. The 
Graduate Placement and COOP programs and Project SET also received less 
emphasis. The third study Included a summary of the overall 3-year evalua- 
tion. The evaluation design consisted of: 

K Career Orientation 

• Administration of an attitude questionnaire to a 10 percent sample 
of Phase I students. 

• Administration of an attitude questionnaire to a sample of parents 
of Phase I students. 



• Administration of an attitude measure to a 10 percent sample of 
Phase I I students. 

• Administration of an attitude measure to a sample of Phase II 
parents. 

• Administration of a performance measure to an 8 percent sample of 
Phase I II students. 

• Administration of an attitude measure to an 8 percent sample of 
Phase I 1 1 students. 

2. Graduate Placement and COOP 

• Administration of an attitude measure to a sample of students In 
the work experience program. 

• Administration of an attitude measure to a sample of employers of 
work experience students. 

3. Prolect SET 

• Administration of an attitude questionnaire to a sample of 
Project SET students. 

• Administration of an attitude questionnaire to a sample of 
employers of Project SET students. 
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V. RESULTS AND DISCUSSION 



The results of the evaluation studies are discussed cumulatively by 
year by project component. A summary of the evaluation results for 1971 
and 1972 will precede the discussion of the third year evaluation results. 

A. Career Orientation 

I . Phase i"6th Grade 

a. 1971 Summary . A meeting between the evaluation staff and the three 
members of the Itinerant team resulted In the following conclusions: 

Three Phase I teachers seemed to have been asked to Implement a 
large and complex program requiring extensive equipment, time, and planning 
to achieve the stated objectives. Although the teachers felt that the pro- 
gram had been somewhat effective, several Important questions were raised: 
Is the program meeting the objectives originally stated? Are these objec- 
tives realistic? Are the specially arranged schedules being used effec- 
tively? Are students learning anything, or are they merely kept busy doing 
something different one day a week? 

The concepts which provided direction for the curriculum were 
sacrificed In order to prepare activities which could be realistically 
Implemented In the classes. Whether this situation was a result of realis- 
tic needs or a modification of the established objectives could not be 
stated at that time. Students seemad to respond to the notion that they 
were *'not really In school'* when they were participating In Career Orienta- 
tion and were not able to relate their activities to any broad conceptual 
scheme linked to subsequent school activity. Career Orientation seemed to 
be more of an activity period rather than one step In a process of choosing 
a particular type of curriculum. 
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b. 1972 Summary > The project monitor selected 8 out of 15 schools to 
participate In this evaluation. The schools used In the sample represent 
a cross section of the socio-economic background of Phase I students. The 
299 out of 1,320 pupils represent 22% of the total enrollment. 

(1) Students' Performance . The results Indicated that students 
performed well on the Phase I achievement test. The student mean of 19.97 
represented a score equivalent to 77% of the Items correct. The students 
evidently learned a large percentage of what the Itinerant team Intended to 
teach. 

The data- Indicated that there were significant differences In 
performance of eight schools In Phase I. Students In the two highest scoring 
schools (West Liberty and Beechwood) averaged 86% and 85% of the test correct 
while the students In the two lowest scoring schools (Holmes and Forbes) 
averaged 60% and 62% of the test correct* It was recommended that project 
management investigate these differences In performance and attempt to 
determine If there are any unique conditions In these schools which might 
explain this variation In test scores. 

Item analysis data revealed that there were some Items on 
which there was wide variation across schools In the percentage of students 
selecting the correct response. This Indicated that there were Items which 
were more difficult for students In some schools than In others. Since the 
Intent of the Phase I program was to teach the same material in each school, 
It was suggested that these wide variations on some Items be Investigated to 
determine If the content did differ by school. 

There were no significant sex differences in performance on 
the Phase I achievement test. The program appeared to be equally effective 
for both boys and girls. 

(2) Students* Attitude . Students liked the program and seemed to 
enjoy the activities In which they participated. Students* attitude was 
very positive on all the scaled Items. On the open-ended Items students 
Indicated very few aspects of the program with which they were dissatisfied. 

A Pearson product moment correlation coefficient was computed 
to determine the relationship between students* attitude toward Phase I and 
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students* performance on the Phase I achievement test. This analysis yielded 
a correlation coefficient of .29 which was significant at the .01 level. This 
Indicated that there was a significant relationship between students* attitude 
toward Phase I and their performance on the Phase I achievement test. 

(3) Classroom Teachers' Attitude Questionnaire . The Classroom 
teachers appeared to be satisfied with the overall concept and operation of the 
Phase I program. The responses suggested that students enjoyed the act Iv Itles 
while learning some Information about OVT and job opportunities. However, the 
lack of communication and coordination between the classroom teachers and the 
OVT teachers appeared to be one area where the program should be strengthened. 
If one of the program objectives was to establish a link between these classes, 
and such a mechanism had been built Into the Phase I syllabus, then the pro- 
cess should have been operational. Instead of OVT functioning as a separate 
activity period where students create products and learn about Jobs, they 
would be able to link OVT activities with their regular classroom experience. 
AIR suggested this process could be operational In two ways. One was to 
Incorporate or set aside some time during In-service meetings for these 
teachers to meet and plan some strategies and activities. The other was to 
set aside a few minutes during the OVT team's visit to brief one another on 
the activities In each class and the anticipated plans for the coming week. 
Even If the teachers did not combine lesson plans, this would Increase the 
Interface between the two classes. 

Itinerant Teachers' Attitude . During the first evaluation of 
this program, the Itinerant teachers expressed a desire to actively parti- 
cipate In curriculum changes and modifications. At that time, the evalua- 
tion was cited by AIR as an opportunity for these teachers to express their 
opinions about the program and to suggest changes for program Improvement. 
Six new teachers were added to the Itinerant group, making a total of nine. 
Yet only two members of these two teams completed this questionnaire. 

c. 1973 Evaluation Results . This year an attitude questionnaire was 
administered to students In the Phase I program. The Instruments were 
administered by members of the Itinerant teams. The team members followed 
their normal teaching schedule and set aside time during their regular 
school visits to administer the attitude questionnaire. 
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(1) Students' Attitude , Project personnel selected the following 
7 out of 17 participating schools In the Phase I program. The schools used 
In the sample represent a cross section of socio-economic background of 
Phase I students. The 192 students participating In the sample represent ]0% 
of the total Phase I enrollment. 

Table 1 Identifies the seven participating schools, the mean 
total score by school, and the number of students sampled In each school. 

Table I 

Phase I 
Attitude Data 
Mean Total Score by School 



School 


Mean 


Number 


A. Leo Weil 


20.35 


37 


West Liberty 


18.52 


21 


Columbus 


18.17 


ko 


Madison 


20.00 


28 


Beechwood 


18.61 


39 


Miller 


17.30 


13 


Holmes 


19.21 


li 


Total 


18.88 


192 



Attitude scores Indicate that students enjoyed their Initial 
experience in Career Orientation. The overall mean of 18.88 out of a 
possible 21 reveals that students liked the Phase I program. The data 
suggests that students In A. Leo Well and Madison Schools enjoyed the program 
most and that students In Miller School enjoyed the program least. 

Table 2 shows the mean subscore by school. The variance by 
Item was low. Only one school on one Item scored less than 2; this Item 
asked students to Indicate how well they learned how to get along with people. 
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AJl other scores In all schools were above 2, which suggested that students 
feit very positively toward Phase I of the Career Orientation Program. 

1. Phase I I "-7th Grade 

a* 1971 Summary . There were 1,635 students Involved in Phase II at 
the Washington and South Side Centers. The sample used for the evaluation 
consisted of 372 students from these centers, or a 23^ sample. 

(1) Students' Performance . Two characteristics of the data were 
worth noting. First, only four of the South Side students were exposed to 
all ten content areas. Were there unavoidable circumstances related to the 
Initial period of Implementation, or did program procedures need revision 

In order to ensure that all students received Instruction in all areas? 
Secondly, the variation In Item scores deserved Investigation. Items which 
proved difficult for students at one Center also proved difficult for 
students at the other Center. These Items needed to be reviewed to deter- 
mine the nature of the difficulty. I.e., whether they contain ambiguities, 
whether they require knowledge whi.ch.Is not being taught, etc. 

There was little variation In scores between males and females. 
Since one of the goals of the project was to expose students equally to 
content areas, the goal seems to have been achieved. 

The changes recommended by the students were: (a) to eliminate 
the mart and keep the Items produced In each area, and (b) to have more time 
In each content area so as to have an opportunity to try the various tasks 
wl thin that area. 

(2) Students' Attitude . Students liked the program and thought It 
helped them make curriculum selections for the next year. Indications of likes 
and dislikes combined with suggested changes raised the Issue of the mart. 

AIR suggested that some questions needed to be answered about It. Why was 
It Included in the curriculum? Should It receive the emphasis It seemed to? 
Was It complementary to the primary objective of the program? Should it be 
continued? 
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(3) Teachers' Attitude , The teachers are In a good position to 
pinpoint difficulties and Identify aspects of the program which need to be 
modified for program improvement, such as the need for nx>re relevant in- 
service training. The responses by the teachers raised some questions about 
the role teachers play In the development, implementation, and evaluation 
process. How should the experience of the teachers In a program be used for 
program improvement? What opportunities are provided by In-service training 
to achieve the objectives of the program? In what way can teachers most 
effectively accomplish program objectives? 

Responses also raised questions about current program activities. 
Were all participants aware of program goals and objectives? How are problems 
encountered in Implementation solved, or are they? 

jh) Principals* Attitude . The principals of both the Washington 
Education Center and the South Side Education Center completed a question- 
naire asking for their judgment concerning the Impact of Career Orientation 
In each of their schools. 

With the exception of one answer, the principals Indicated 
that they believed Career Orientation was and had been successful In the 
schools, students enjoyed their participation In the program, they enjoyed 
having the program In their schools, and that the program had stimulated 
favorable parental Interest and comment. The one exception was that one 
principal Indicated an Indeclslveness about whether classroom teachers 
thought the program was successful. 

One principal suggested that Junior Achievement should only 
be a portion of the 8th grade curriculum and that course content emphasis 
should be on exploration rather than production. The latter remark correla- 
ted highly with both teachers' and students* recommendations. 

b. 1972 Summary . Phase II student enrollment totaled 2,850. Eleven 
percent, or 325 students were sampled. 

(1) Students' Performance . Mean student performance on the 
Phase II achievement test resulted In (>]% of the Items being answered 
correctly. OnjB significant difference between the evaluation results of 1971 




and 1972 could be seen In the proportion of students in the OVT Centers who 
received Instruction In all content areas. In 1972, unless a feeder or home 
school Joined the OVT program following the starting date, all students 
participating In Phase M received Instruction In all content areas. 

(2) Stud ents' Attitude . Data from students' attitude question- 
naires suggested that students enjoyed the Phase It activities. In addition, 
most students Indicated that Phase M activities helped them to select the 
four subject areas they would like to explore further In Phase Ml. Only k 
out of 325 students said Phase II did not help make this decision; 203 
students responded that It helped a lot. 

The open-ended response Items provided students the opportunity 
to Indicate what they liked best and least about the program. Most students 
responded by stating which areas they enjoyed best or least. Some students 
suggested that the best aspect of Phase II was the chance to learn about 
career opportunities. This Indicated that one of the major program 
objectives was achieved. Student responses were not as varied this year 
as last. The responses to aspects of the program enjoyed least by students 
were Identifications of specific subject areasv No major trends were Iden- 
tified which Indicated a general negative attitude about the program. 

(3) Teachers' Attitude . The 15 out of 30 teachers who responded 
to the questionnaire seemed to regard the Career Orientation program pro- 
fessionally challenging and rewarding. Their responses indicated that they 
were Interested In continual training In methods which would increase their 
effectiveness as teachers. The results also suggested that although they 
had been briefed In the middle school philosophy, the teachers had not 
received enough pragmatic tools with which to conduct and Implement the 
objectives of Career Orientation. In addition to this questionnaire. Infor- 
mal conversations with some of these teachers throughout the course of this 
evaluation supported this general feeling. These teachers were embarking on 
a completely new and innovative learning situation which required Innovative 
training In methods and strategies. A number of teachers stressed that In- 
service training should focus more on how to achieve program goals than 

on group dynamics and the philosophy of the middle school. 
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Because 50% of the respondents Indicated that the syllabus was 
unsatisfactory, AIR suggested a review of the syllabus or the curriculum 
objectives should be conducted by project management. Teachers should be 
asked to cite specific Incidents where the syllabus was unworkable In order 
to supply Information for useful revisions. 

c> 1973 Evaluation Results . 

(1) Students' Attitude . This year attitude questionnaires were 
administered to 272 out of 2,736 Phase II students In the five OVT Centers. 
This represents a ]0% sample of students participating In the Phase M 
program. The teachers In each of the OVT Centers administered the question- 
naires to their students. 

Table 3 summarizes the questionnaire data by OVT Center and 
overall. Within a range of three choices, each assigned a numeric value 
(l-3» with 3 the most positive), students were to Indicate their attitude 
toward selected segments of the Phase II program. Data from the students' 
attitude questionnaires suggested that students enjoyed the Phase II 
activities. All of the overall Item mean scores were above 2. In addition, 
the vast majority of students Indicated that Phase II activities helped them 
to select the four subject areas they would like to explore further In 
Phase II. Only 9 out of 272 students ^sald Phase II did not help them to make 
this decision; 180 students responded that It helped a lot. 

Tables 4, 5, 6, 7, and 8 on the following pages present the 
mean score by Item by school by OVT Center. The Information summarized In 
the preceding paragraph Is extended to this form for the reader Interested 
in Individual schools within the OVT Centers. 

(2) Parents' Attitude . This year, at the request of the Project 
Monitor, questionnaires were submitted to parents of students enrolled In 
the Phase I and Phase II programs. AIR mailed a total of 3^^ questionnaires 
to a list of 3^^ parents submitted by OVT. Only questionnaires, or \2% 
were returned. Responses on those questionnaires received from the parents 
of students enrolled In the OVT program were generally positive; the parents 
Indicated that the program helped their children. 
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Table 6 



Phase II 

Attitude Data 
Subscore by Home School 
01 i ver 

Columbus Middle (N=22) St. Gabriel's (N=.9) 

^ ^ R ~7I 

Question la 2.i»5 22 2 9 

^ 2.90 22 2;88 9 

; 2.77 22 2.66 9 

d 2.27 22 2M 9 

e 2.77 22 2.33 9 



2a 2.54 22 iM 9 

^ 2.95 22 2.66 9 

C 2.59 22 

d 2.31 22 



2.55 9 
2.66 . 9 



e 2.81 22 2.66 9 

HI " 2.33 9 

b 2.68 22 2.66 9 

2.J5 22 .. 2.88 9 

e 2.81 22 » 2.i»i» 9 

4 2.80 16 2.88 9 
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Table 8 

Phase il. 

Attitude Data 
Subscore by Home School 
McNaugher 



Question la 
b 
c 
d 
e 

2a 
b 
c 
d 
e 



3a 
b 
c 
e 



McNaugher (N^SO) 
M N 



2.90 
2.38 
2.22 

ZM 
ZM 



50 
50 
50 
50 
50 



2.55 
2.32 
2.^18 
2.89 
2.59 



'•9 



Z.kO 
2.38 
2.59 
2.53 



2.52 



'lO 



49 

^3 



Eight parents stated that It was a good program. Reasons why 
parents liked the program were that the program gave the students some knowl- 
edge about career opportunities, It helped prepare them for future jobs, 
and aided In making decisions about these Jobs, In addition, It enabled 
students to gain experiences beyond those provided H the normal curriculum. 
Many parents felt the program was useful enough to be a requirement for all 
students. Two negative parents' comments Indicated that the program had too 
much variety and therefore was not helpful. 

Some students discussed OVT at home. In so doing, they usually 
mentioned OVT activities; sometimes they commented about special events of a 
day. Nine parents stated that their children found OVT very enjoyable and 
liked the knowledge they acquired and the opportunity of taRIng about occupa- 
tional opportunities. Parents stated that students learned about the world 
of work. Four parents indicated that the program assisted their children In 
focusing on career goals. A few parents stated that the relationship 
between OVT and occupational opportunities was not discussed at home. 

Parents responded favorably that the OVT Exploratory Program 
had been helpful to their children. Seven parents stated that the program 
gave the students new and varied Ideas about careers. Thre^ stated it was 
a change of pace from the normal school curriculum. Others thought that 
the experience allowed their students art opportunity to be creative and 
develop skills, gain new experiences, and learn useful and Interesting 
things to do. A few parents liked OVT because It taught their children 
things which the parents are not equipped to teach. A few parents stated 
that the OVT Exploratory Program was least helpful because It attempted to 
cover too many topics In a short time. 

Parents suggested a few changes which they thought could 
Improve the program. For example, they suggested that the scope of the 
program be reduced and the length of time alloted for subjects and projects 
be Increased. In addition, they recommended program expansion to more grades 
In more schools with perhaps a follow-up of on-the-job experience. 



3- Phase I I |-8th Grade 



a. 1971 Summary . Because Phase Ml was not operational In 1971, no 
evaluation effort was directed toward this segment of the Career Orientation 
Program. 



b. 1972 Summary . Phase III- was staffed by the same 30 teachers who 
staffed Phase IL The only data received about Phase III came from these 
teachers' responses to an attitude questionnaire. 

The training preferences and the In-servlce training were almost 
Identical to those expressed for Phase 11. The course syllabus was unsatis- 
factory for most teachers. 

As with Phase II, the teachers appeared to be very Interested and 
challenged by the Career Or len tat Ion Program. They were wl 1 1 1 ng to Invest 
their time and talent to achieving the program objectives, but they were not 
always clear about what those objectives really were. The training sessions 
did not seem to offer practical suggestions for teaching this Innovative 
program for career exploration. 



One apparent difference between Phase II and Phase III was the 
group Instruction received In Phase II compared to the self -contained 
learning activity packages used In Phase III. Although the concept of a 
business organization seemed to work successfullV In Phase II, teachers 
suggested It might not be appropriate for Phase III. The teachers also 
Indicated that the retailing activity built Into Phase III was the least 
effective aspect of the program. Informal conversations with the teachers 
Indicated that this situation was one which project management and the 
teaching staff were aware of and an attempt was being made to select an 
alternative strategy. 

c. 1973 Evaluation Results. Each year, when the evaluation study 
focused on a new component of the vocational counseling program. It was 
necessary to develop additional Instruments. Continuing with the interactive 
evaluation process, project staff members and the evaluation staff worked 
together to build these Instruments. Phase III was fully operational during 
this year's evaluation study and received the primary focus. Therefore, a 
students* performance measure was created from Items submitted by teachers 
to AIR, where they were edited and developed Into the final evaluation 
Instrument. The students* attitude questionnaire used In previous evalua- 
tions for Phase II was also administered to a sample of Phase III students 
participating In the evaluation. 

ERIC ■ 



The AIR Project Director visited each of the sites where the 
evaluation was conducted and discussed the administration of the Instruments 
with the OVT Center administrator. The evaluation Instruments were then 
turned over by the administrator to the teachers who administered them to 
the students. By so doing, the normal school operations were minimally 
disrupted because the teachers arranged the evaluation In the way most 
compatible with their schedules. The following OVT Centers participated In 
the evaluation: Arsenal, South Side, Washington, Oliver, and McNaugher. 

The total number of students sampled was 222; this represents 8? 
of the total Phase III student enrollment. Table 9 shows a breakdown of the 
mean total achievement scores by OVT Center. 

Table 9 

Phase 11 I 
Achievement Data 
Mean Total Score by OVT Center 



Schoo l Mean Number 

Arsenal 29.77 ^5 

Oliver 31.11 30 

McNaugher 2^^.06 52 

South Side 29.7^ 3^ 

Washington 26«60 6] 



(0 Students' Performance . The overall mean score achieved by 
students was 28.25 out of a total possible score of 50. Students correctly 
responded to approximately 56% of the Items. It should be remembered that not 
all students answered all items on the test because not all students were 
exposed to all the occupational areas Included on the test. Phase Ml 
students enrolled In a limited number (usually four) of the total of ten 
areas In which Instruction was offered. The breakdown of the number of 
students In each home school who answered each occupational area Is shown 
later In this section. As can be seen In the above table, differences In 
total scores exist among the OVT Centers. McNaugher scored the lowest 
while Oliver scored the highest. 



52 



Table 10 presents the achievement test scores by OVT Center* 
Last year, students In the four OVT Centers participating In the evaluation 
achieved their highest scores In Community Services and Foods s Nutrition. 
This year, students In three out of five Centers scored highest on Community 
Services; students In three Centers received one of their two highest scores 
In Clothing S Textiles, and Merchandising. The schools were scattered In 
recording low scores; the only pattern was reflected In three out of five 
OVT Centers where the lowest scores were obtained In Visual Communications. 

Table U presents the number of students within each OVT 
Center who responded to questions with each occupational area. The two most 
popular areas chosen by students seemed to be Clothing S Textiles, and 
Foods S Nutrition. The area chosen by the fewest students seemed to be 
Visual Communications. 

The data have been broken down further In subsequent tables. 
Tables. 12, 13, 1^, 15, and 16 show the achievement test subscore by home 
school within each OVT Center. Tables 17, 18, 19, 20, and 21 show the number 
of students In each home school within each OVT Center who responded to 
Items In each occupational area. 

(2) Students' Attitudes. Data from students' attitude question- 
naires suggest that students enjoyed the Phase III activities. Tables 22, 
23, 2^, 25, and 26 show the breakdown of students* responses by Item by 
home school by OVT Center. Within a range of three choices, each assigned 
a numberlcal value (l-3» with 3 the most positive), the vast majority of 
overall Items mean scores was over 2. In addition, the majority of students 
indicated that OVT had helped them choose a course of study for the next 
year. 
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Table 15 



Phase I 1 1 

Achievement Test 
Subscore by Home School 
01 Iver 





Col umbus 
M 


N 


Clothing 6 Textiles 


3.57 


26 


Community Services 


^.57 


U 


Foods 6 Nutrition 


2.86 


30 


Manufacturing 


2.77 


9 


Construction 


2.61 


13 


Power & Transportation 


2.85 


20 


Visual Communications 


2.33 


18 


Merchandis ing 


3.8i» 


25 


Business Communications 


2.52 


25 


Information Processing 


3.19 


21 
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Table 16 



Phase 1 1 1 

Achievement Test 
Subscore by Home School 
McNaugher 



McNaugher (N=5^) 



Clothing 6 Text i les 

Community Services 

Foods 6 Nutrition 

Manufacturing 

Const ruction 

Power & Transportation 

Visual Communications 

Merchand ising 

Business Communications 
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Table 20 



Phase III 

Achievement Test 
Number of Students per School Answering each Area 
01 Iver 



Columbus (Ngitl) 



Clotiiing 6 Texti les 


26 


Community Services 


14 


Foods £ Nutrition 


30 


Manufacturing 
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Construction 


13 


Power 6 Transportation 


20 


Visual Communications 


18 


Merchandising 


25 


Business Communications 


25 


Information Processing 
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Table 21 

Phase III 

Achievement Test 
Number of Students per School Answering each Area 

McNaugher 



i^t ^ . McNaugher (N«5^) 

Clothing s Textiles ^ 

Community Services 50 

Foods & Nutrition 52 

Manufacturing j^g 



Construct Ion 
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Power & Transportation /|6 

Visual Communications /i5 

Merchandising i^j 

Business Communications l^j 
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Table 25 

Phase III 

Attitude 
Subs core by Home School 
McNaugher 

McNaugher {H=Sh) 



Question la 
b 



2.50 
2.33 
2.35 
2.^*9 



53 
53 
53 
53 



c 



2a 
b 



c 



2.5^ 
2.15 
2.30 
2.^*9 



53 
53 
53 
53 



3a 
b 



2.^*7 
2.09 
2.39 
2.30 



53 
53 
53 
53 



c 
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Table 26 

• Phase 1 1 1 

Att itude 
Subscore by Home School 
01 Iver 



Columbus (N°35) 

M N 

Question la 2,50 30 

b 2.53 30 

c 2.80 30 

d 2.20 30 

2a 2.^10 35 

b 2.^18 35 

c 2.^18 35 

d 2.17 35 

3a 2.71 21 

b 2.71 21 

c 2.66 21 

d 2.^17 21 

4 2.32 34 
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B, Graduate Placement and COOP Programs 



K 1971 Summary 

The scope of the Graduate Placement program is reflected In the follow- 
ing figures provided by the Pittsburgh Public Schools. During the period 
June 1968 through April I569, of a total of 2,653 students certified by 
counselors as ready to work, 1,^98 were placed. Of the 1,155 not placed, 
the majority (1,017) had elected some other post-graduate option (military 
service, marriage, further education) had not fulfilled requirements for 
graduation, or had otherwise voluntarl ly excluded themselves from the 
placement program. 

The Intent of the COOP program was to provide work experience as an 
adjunct to classroom Instruction during a student's senior year. The COOP 
program has made available this work experience In virtually all areas of 
comprehensive specialization. As of February 1971, approximately ^29 
students from all city high schools were enrolled In this program. 

A survey of students, employers of students, and project staff members 
suggested both programs were well conceived and administered, with an eye 
toward continuous updating and staffed by concerned, competent, and dedicated 
professionals. In terms of virtually all program objectives, the picture 
resulting from an analysis of the data was quite favorable. 

2. 1972 Summary 

The follow-up study of June 1971 high school graduates, prepared by 
Systems-Wide Programs and Services of the Pittsburgh Public Schools, Indicated 
that 4,A97 students graduated from the Pittsburgh Public Schools. Of that 
number, 56.8^ entered post high school education; 25*3^ became employed; 
\h.0% either left Pennsylvania, were unavailable for Immediate employment, 
or were waiting for job placement; and 3.9^ entered the Armed Forces. 
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The COOP program Included work experience In all areas of comprehensive 
specialization. As of June 1971, ^21 seniors were enrolled In ski 11 -centered 
courses; the enrollment figures Include students from both the academic and 
general courses of study. Upon graduation, 33.3^ had entered post high 
school education; were employed; 16.2% were either residing in another 

state, unavailable for Immediate employment, or waiting for job placement; 
and entered the Armed Forces. 

Both these programs are Integral parts of a broader system of counseling 
which Includes testing and guidance components, the Instructional process and 
other school and work-related experiences which Influence the student., 

A new feature was added to the COOP placement facilities at the OVT 
Center. Based on a model of a 6-year operational School of Industry Job 
Development Program, the Pittsburgh Urban League vvorked with the Pittsburgh 
Board of Education to design and Implement a job center In each of five 
Pittsburgh high schools. The purpose of these job placement centers was 
to provide employment opportunities for seniors In the Inner-city who are not 
continuing their formal education beyond high school. 

The program offers on-site recruiting of students by employers In a 
mass job placement effort at the job centers. For students not exposed to 
the skill-centered training programs, supportive assistance was provided 
In the area of pre-work preparation. For example, the student could be 
interviewed in the familiar atmosphere of school surroundings. Many 
students were placed In jobs as a result of the job center. The job center 
concept supplements the system-wide placement program currently in existence. 



3. 1973 Evaluation Results 

Table 27 shows the number of graduating seniors enrolled within the 
Placement Program who did not continue with post high school, full-time 
education. The scope of the work conducted at the job centers within these 
13 participating schools Is reflected In these figures, which were provided 
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by the Placement staff. In 1972, the Industry Job Development Program imple- 
mented these Job Centers in five Pittsburgh high schools. The number of 
schools Increased to 13, serving 6,538 students. This year's evaluation for 
this segment focused on gathering attitude data from a sample of students 
and employers of students In the programs, 

a. Students' Attitudes . Responses were received from 11 out of 75 
questionnaires mailed to Cooperative Work Experience Program students. 
This represents only a ]h% sampling; the results discussed below reflect 
the responses of this sample. Students were asked to Identify their first 
contact with the COOP Coordinator. The responses Indicated that these 
contacts originate from three primary sources — the school counselor, the 
Distributive Education Coordinator, and other students enrolled In the 
program. Students stated that contact with the Coordinator was made either 
in the latter part of the 11th grade or the beginning of the 12th grade. 
Students Indicated that during this initial contact, they discussed the 
benefits of the COOP and hov/ It aided In finding employment, emphasized the 
importance of skill-training, oriented students on Interview techniques, 
and stressed the necessity and usefulness of certain types of courses. 

Students identified various ways In which the Coordinator assisted 
them In selecting a satisfactory COOP program. The focus of this assistance 
seemed to depend on matching student qualifications with the potential job 
and advising students about curriculum selection. 

There appeared to be no definite relationship between the number of 
times a student asked and then met with the Coordinator. Two Coordinators 
asked to meet with students more times than the students asked to meet with 
them; three students requested more meetings than the Coordinator. The 
majority of the time each Individual requested a meeting, one was scheduled. 
Arrangements could always be made for meetings. 

Student advice on employers' expectations came from various sources. 
Students received advise from teachers and the Coordinator, from other stu- 
dents In the program, and sometimes from outside Individuals such as guest 
speakers at the school. 

ERIC 80 . . 



In stating reasons why they chose a particular skill area, students 
cited Interest, necessity for experience in a chosen skill, and current 
and potential pay scales. Seven students stated that their COOP experience 
matched their sl<ill training. In most cases, their class worl< prepared 
them for their occupational duties. In addition, students experienced 
Involvement with new people, training by a company, and gained knowledge 
of the business world. Two students stated their work did not match their 
traini ng. 

Students expressed Interest In various career plans following 
graduation. Some chose to receive a higher education In a specific field, 
to obtain a specified job, to attain a certain level of employment, and to 
receive an apprenticeship In the student's present job. Factors that affect 
students' career decisions consisted of work experience, the opportunities 
they received to learn about specific careers, acceptance Into schools, 
salary, and hours. 

Suggested student changes in the work experience program focused 
on extension of the program, additional occupational training, raising 
standards of school courses, and making the program available to lOth, 11th, 
and 12th grade students. 

Overall, students seemed to be satisfied with their work experience 
program. The number of questionnaires returned, however, represents a low 
sample, and therefore It Is difficult to use the Information to recortmend 
changes . 
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The following list of employers was given to AIR by the Project 
Coordinator. The asterisk (^) Identifies the employers from whom 
AIR received responses. 



EMPLOYERS 

F* W. Woolworth 

Norths I de Informer 
*Morrcraft Co. 
*WTAE Channel k 
-Glo-Ran Pet Shop 

ASP 

Sears 

Homes 

Blue Cross 
C. Murphy's 

Kaufmann 's 

S. Safety Trolley 

Gateway Fruit Co. 
*Roth Cash Register Co. 
'"Schaefer Machine 

Lerner Shops 

Union National Bank 

Neyhart Print Co. 

Gulf Oil Co. 

"First Fed. Savings £ Loan Assoc. 
'^Household Finance Corp. 
*Wheel-A-Brator-Frye Inc. 
"Deeter, Ritchey, Sippel Assoc. 

Highland Arco Service 

Harry Survls Auto-Seat Cover Co. 
'^Morris Paper Co. 
'^Hansmann's 
"Kroger 's 
*Mc I nty re Cake 

Glmbel s 

Penn Brook 
^Rockwel 1 International 
^^Postal Instant Press 

Keystone Mailing Service 
-"^Schiff Printing 

Board of Education 

Machunga Enterprises 

U. S. Army Corps of Engineers 

Alcoa 

Wll lie McClungs 

Wi 1 llam*s Instant Copy 



EMPLOYERS 

W. T. Grants 
*Jacobson Picture Frame 
Stubbs Auto Body 
Cox's 

Kings ley House 
Riley's Boron 
Foodland 

Ray Printing Co. 
"Standard Office Supplies 

Gulf Gas Dormont 

Becker's 
"Protective Clothing Co. 

Olympic Sport Center 

Designers Forge 

Maintenance Engin. 
"All ied Electric Co. 

Lawrencevel le Screw Co. 

Mi ller School 

Chiocca Auto Bod^ 
*Westlnghouse Credit Corp. 

Ernie's Auto Body 

Russell ton Auto 

McCleary School Daycare 

Mondaes Auto Supply 
"Prion Machine Tool Co. 

Frey Cabinet 

American Thermo Plastic 

Gestetner Corporation 

Honeywell Corp. Union Carbide Bldg. 

Smith Waterhous^ Corp. 

American Telephone Co. of Western 

Pa. 
*Blue Cross 

Hamilton Inc. 
"Mel Ion ,Bank 

Travelers 
^Bel 1 Telephone Co. 

Sierra Permaucer Furniture Co. 

Pennsylvania Sling Cobb Wire S Rope 
"lionus Wagner Co. 

United Parcel Service 
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b> Employers^ Attitude^ The 11^ employers listed above were each 
mailed a questionnaire which requested their opinion of the vocat lona I training 
of the students they hired from the COOP Program. The following description 
of the employers' attitude Is presented according to the responses received 
to each Item; the description will be more clearly understood If the reader 
refers to Table 28 on pages 66 and 67. Responses were received from 32 
employers, representing about 2S% of the total number of employers to whom 
AIR mailed questionnaires. 

The majority of the employers (20) represented relatively small 
organizations employing fewer than 50 persons as shown on Table 29. The two 
largest categories of employment for which these companies hired OVT graduates 
were secretarial/clerical and labor. 

Employers' responses to Questions 3, ^, and 5 Indicated that OVT 
graduates are perceived In a relatively favorable light. A total of 26 
respondents either agreed or strongly agreed that the OVT graduate performed 
an adequate job; 27 Indicated that the OVT graduate required about the same 
or less orientation than other new employees; and 29 Indicated that relative 
to other new employees, the performance of OVT graduates was at at average 
or above-average level. 

Question 6 provided employers with an opportunity to express any 
problems they might have experienced with the OVT graduate. Of a total of 
32 respondents, 18 either did not indicate any problem or wrote ''no 
problem." Of the problems indicated, the greatest number (10) was assigned 
to an attitude and motivation category. Included In this category were 
such statements as, "Employees are not punctual," and "Employees lack 
enthusiasm." Other problem categor I es included poor language use, lack of 
general skills, and appearance. 

Question 7 requested employers to rate attendance and attitudes of 
OVT graduates to supervision and co-workers. For all three areas, ratings 
ware highest between acceptable and excellent. Five stood at the beiow- 
average level . 
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Table 28 
Employer's Questionnaire 

The purpose of this questionnaire is to ask your general opinion regarding the adequacy of vocational 
training, as reflected in the job performance of Pittsburgh Public School graduates within your employ. Your 
objective response to these items will help insure that Occupational and Vocational Training (OVT) programs 
remain responsive to your needs. 



Employer Identification 
Name of Organization 
Type of Operation 



Number of Employees at this Site 

Total Number of Employees in Company 



2. For what types of employment have you hired OVT graduates (check as many as apply) 

18 Secretarial, clerical _2 Maintenance 

— 6— Labor Cosmetology 

5_ Skilled trade _j Transportation 

Medical, dental, lab assistant Data Processing 

2 Food Services _2 Other (explain) _ 

g Sales 

1 Bank services 



3. The OVT graduates that I employ are doing an adequate job. (Circle the appropriate number) 

c \(0) n Mo) 3 /gX 4 (19) 5 (7) 

Strongly Disagree Neither A^r^e Agree Strongly 

Disagree Nor Disagree Agree 

4 Relative to other new employees, how much orientation and training is required before the OVT 
graduates can perform the job satisfactorily? (Circle the appropriate number) 

1 Less orientation (2) 

2 About the same (25) 

3 More orientation (5) 

5, Relative to other new employees, how would you rate the performance of OVT graduates' (Circle the 
appropriate number) 

1 Above average (8) 

2 Average (21) 

3 Below average (3) 

6. What major problems have you had with OVT graduates' 
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Table 28 contd. 



Based on your experience with OVT graduates, rate their attendance, attitude toward co-workers, and 
attitude toward supervisors hy circling the appropriate rating for each of the behaviors indicated in the 
chart below. 
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Rating 








Excellent 


Attendance 


Attitude Toward 
Co-Workers 


Attitude Toward 
Supervisors 


(18) ^ 


(16) ^ 


(17) ' 


Acceptable 


(10) 3 


(16) ^ 


in) ' 


Below Average 




(0) 2 


(1) ' 


Unacceptable 


(0) 1 


(0) ^ 


(0) ' 



Training received by OVT graduates has been braod enough to allow them to transfer between jobs 
requiring moderately different skills. (Circle the appropriate number) 



1 (0) 
Strongly 
Disagree 



2 (3) 

Disagree 



3 (12) 

Neither Agree 
Nor Disagree 



OVT graduates are highly promotable. (Circle the appropriate number) 
1 



^ (1) 

Strongly 

Disagree 



2 (0) 

Disagree 



3 (20) 

Neither Agree 
Nor Disagree 



4 (12) 

Agree 



4 (9) 

Agree 



5 (2) 
Strongly 
Agree 



5 (1) 
Strongly 
Agree 



10. When you are in need of employees, there are a number of sources that you might utilize. For the 
sources listed below, indicate your first, second, and third preference by placing the number 1 , 2, or 3 



before the source. 


iil 


ill 


ill 


Private employment agency 


0 


2 


5 


State employment agency 


1 


2 


5 


Your own ennployment office files 


16 


2 


3 


Relatives, friends or acquaintances of present employees 


k 


9 


1 


* Public school sources (guidance counselors, vocational coordinators, etc.) 


8 


11 


9 


Other (please specify) 


2 




5 



11. Do you have, or have you ever had, a COOP (Cooperative Work Study Program) student in your 
employ? (Circle the appropriate response) 

1 Yes (30) 2 No (2) 

If yes : a. How many of these students have you had in your employ? 

b. Of this number, how many continued in your employ after graduation? 



12. These COOP students were sufficiently prepared to make a positive contribution to my operation. 
(Circle the appropriate number) 



1 (0) 

Strongly 

Disagree 



2 (2) 
Disagree 



3 (3) 
Neither Agree 

Nor Disagree 



4 (22) 
Agree 



5 (5) 

Strongly 
Agree 



(luo«tlonn«lre prepared by American Institutes for Research, Pittsburgh, Pa. 

85 88 



Tabli 29 

Size of Organizations Responding 
Number of Employees 0-10 II-50 50-100 101-500 Over 500 

Local Site 9 11 2 6 i» 

Total Company 5 II | 2 7 



Table 30 

Number of COOP Students Employed 
Number of Students I-5 6-10 11-20 Over 10 

Employed 15 8 2 1 

Retained After Graduation 2k ] \ n 
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Responses Indicated that employers agreed or strongly agreed 
that OVT graduates could be promoted In their companies; 12 respondents 
remained neutral. Responses toward promotabi 1 Ity Indicated that 10 respon- 
dents agreed or strongly agreed that OVT graduates are highly promotable; 
20 remained neutral • 

The employers were asked to Indicate first, second, and third 
source preference for new employers. Most employers (16) Indicated that 
their first choice was their own employment files, while 8 preferred public 
school sources. Employers' second choice for new employees, however. Is 
the public school sources, followed by relatives, friends, or acquaintances. 
When first and second source preferences combined, public school sources 
were mentioned most frequently with 19 responses, followed by personnel 
employment office files (16 responses). 

Of the 32 respondents, 30 had employed or currently employ COOP 
students. The number of COOP students presently employed by any one organiza- 
tion was relatively small, but most organizations Indicated that they employed 
from one to five OVT graduates at one time or another. Question 12 asked 
for an evaluation of the COOP students' preparation In terms of making a 
positive contribution to an employer's operation. Of the 32 COOP employers, 
22 agreed that these students received adequate preparation 5 more strongly 
agreed. The largely positive response to this Item would appear to indicate 
that the COOP student Is perceived as a valuable addition to the work force 
by most employers. 

According to the sample of employers who responded to the question- 
naire. It seemed that OVT graduates are capable of joining the business 
world, with no outstanding problem areas. Most of the employers hired OVT 
graduates as secretarial or clerical personnel. Overall, the graduates 
were viewed favorably and performed well on their jobs. Their attitudes 
were positive. Those few employers who had comments about minor problems 
stated that attitude ranked high, but the number was quite small. One Index 
of how well the OVT graduates blended Into the work force was provided 
through the willingness of the employers to transfer these graduates to other 
tasks— either at a parallel or a higher level. 
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C. Project SET (Select Employment Trainee) 



1. 1971 Summary 

The staff effort during this period was directed toward the planning 
and development of this pilot program. AIR*s role at this time was to review 
and comment on this preparation. AIR indicated that the planned activities 
were accomplished and, where applicable, incorporated the products of those 
activities. The preparation phase reflected the large amount of time and 
effort required In planning and preparing for the Implementation of an 
Innovative educational process. Unfortunately, all too often in other pro- 
jects of this nature, this phase is omitted; planning and Implementation are 
attempted simultaneously, with understandably unsatisfactory results. 



AIR felt that the activities of Phase I represented a commendable 
overall planning effort and recommended comments directed toward Identifying 
important areas which required further detailed attention early in the Imple 
mentation process. A definitive frame of reference, together with well- 
defined means for detecting and communicating needed change, greatly 
facilitated the adjustments and modifications which were anticipated as the 
program evolved . 



2. 1972 Summary 

Attitude questionnaires were administered to samples of various program 
participants — students, parents, employers, and staff. 



a. Students' Attitude . Students* attitude toward the work experience 
program seemed to be positive. Students enjoyed having the opportunity to 
work and earn money; in some cases, it was a motivator toward remaining in 
school. One disturbing factor which emerged from these results, however, 
was the student feeling regarding negative employer and employee attitudes. 
This might have resulted from a student's prior experience and AIR suggested 
that this be examined during Individual counseling sessions. 



b. Parents' Attitude . The small parental return rate (15.5^) made it 
difficult to assess the attitude of the parents toward the program. However, 
If these responses were an accurate reflection of parental attitude, the 
program was positively received by parents. Not only did they enjoy having 
their children employed, but they also felt relieved because the young people 
were able to buy some things parents could not afford to obtain for them. 
Another positive side effect was the willingness of students to continue 
attending school and their realization of the Importance of at least a high 
school diploma in the acquisition of employment. 

c. Employers' Attitude . The Project SET coordinator supplied AIR with 
a list of 28 employers with whom 33 students in the cooperative work experi- 
ence program were currently or previously affiliated. A total of 25 
employers were interviewed by phone; 21 students were still working; and 

the remaining 12 were no longer employed either because they quit or had been 
asked not to return to work. 

None of the employers who were interviewed offered negative comments 
about the program operations or the program staff; there were, however, a few 
suggestions for modification, based on their individual experiences with the 
program. For example, one employer commented that his student employee was 
not cognizant of the entire program of which she was a part. She did not 
understand what any other students were doing. This employer suggested a 
regularly scheduled meeting where the student participants could share the 
experiences of their jobs. In addition, school and program staff members 
could attend in order to receive some feedback about actual operations In 
the field. 

One of the most common remarks made by the employers was a lack of 
student awareness concerning job courtes ies--not phoning in to report off, 
high absentee rate, tardiness when reporting to work, irregular attendance, 
and quitting with no notice. There seemed to be certain aspects of job 
responsibility for which these students were completely unprepared. Some 
employers suggested an orientation program designed specifically to discuss 
the "nuts and bolts" of job courtesies. 
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The discussions with the employers yielded some additional anecdotal 
Information. Most of the employers who experienced positive results with 
their student employees Indicated a willingness to participate again In the 
program by tal<lng another student during the next term. No one expressed 
outstanding critical comments about the program-generally, they felt it was 
a worthwhile idea which had social significance. A few expressed dismay at 
the extensive time involved in working with and training these students, and 
they did not feel a sufficient return on the investment of their time and 
effort. Overall, most employers were wlllinq to contribute the necessary 
efforts to expose the students to the business world. 

^ — Staff Attitude. All three members of the Project SET staff 
responded to the attitude questionnaire. The purpose of the questionnaire 
was to gather information about the staff's opinions on training, need for 
additional support within the school system, and the role of the students 
In the program. 



Overall, Project SET personnel seemed to feel positively about the 
program. Many of the comments and suggestions coincided with the student 
responses. For example, both groups identified the negative attitudes 
exhibited by some employers and their employees toward the students. Staff 
comments suggested that they worl< together to mal<e the program successful 
and agreed upon specific areas where the program could be Improved. 



3' 1973 Evaluation Results 

The following program descriptions and objectives reflect an updated 
version of Project SET. As of July 1973, Project SET became part of an 
expanded program entitled, "Cooperative Work Study Program for Disadvantaged 
Urban Youth." Program objectives remain the same as do other program 
characteristics. The staff includes one coordinator-counselor six teacher- 
coordinators, three paraprofessional s , and one clerk who serve an additional 
180 students in 13 high schools. 
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Purpose of the f'rogram: 

Project SET utilizes special methods of counseling, curriculum, and 
media to closely support specific students. These students have been 
Identified as grossly alienated from the educational process, and most 
aspects of personal adjustment and community life. On-the-job training 
Is used as a positive Inducement Into the student's lifestyle, hope- 
fully to alter his or her perception of school and the world of work. 
Vital to the program Is a component that assures students one credit 
for every 180 hours of successful, supervised work experience. Addi- 
tional credits may be awarded on the same basis, but will not exceed 
two credits per year in grades 9-12. 'intensive counseling and suppor- 
tive aid are provided to assist the student In both the academic 
classes and on-the-job training sites. 

Student and Program Support: 

SET students have always presented severe problems to all employees 
of the school they attend, ranging from principals to custodians. 
According to the staff, many school personnel find It extremely dis- 
tasteful to even discuss some of SET students. Within the last year 
many special accommodations were provided that assisted the SET staff 
in supporting their students. Specific school personnel made these 
alternatives possible. Some alternatives were more difficult than 
others, but In each case the accommodation was the remedy to a specific 
need that no allowances could be provided for through routine channels. 

Other agencies outside the school system made public their opinions 
of this needed and successful program. The Mayor's Office provided the 
students with $3,000 worth of transportation tickets. Bell Telephone 
and the United States Postal Service have assisted by providing work 
sites to students that they normally would not. The reason was the 
extensive counseling and supportive aid provided for each student by 
the SET staff. 

General Objectives: 

• To assist the student to gain a skill and recognize a value for 

education and work while employed part-time in business and industry. 
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• To demonstrate that the private sector, local school systems, and 
government agencies can effectively coordinate t+ieir Individual 
efforts in providing alienated youth with meaningful counseling, 
career exploration and training experiences, and to develop Innova- 
tive program models for these experiences. 

• To help disadvantaged alienated students achieve positive work 
experiences while they continue formal education and training 
to prepare for the world of work. 

• A general objective of the program Is to support the student In 
every way possible (school, job, and home) to remain In school 
and graduate. 

Counsel Ing: 

• To Identify student attitudes toward education and work. 

• To Identify the students* Interests and capabilities, then use 
them as a basis of counseling In determining training and career 
exploration potential. 

• To provide supportive counseling In an attempt to develop positive 
attitudes toward employment and education. 

Pre-Job Training: 

• To develop an open, non-structured participation program which 
utilizes filmstrlps, movies, tapes, and role-play activities to 
provide experiences in potential employer-employee situations. 

• To explore careers Identified as relevant to student Interests. 

• To Initiate an Intensive approach toward students self-modification 
of attitudes and behavioral patterns considered detrimental to 
employer-employee relations. 

On-the-job Training: 

On-the-job training positions were developed by the Project SET 
staff. The following list contains the names of participating compan- 
ies and the type of training the SET students received as of April 1973. 



COMPANY 



NUMBER OF STUDENTS 



TYPE OF TRAINING 



I. 

2. 

3. 
h. 
5. 
6. 
7. 



8. 

9. 
10. 
II. 
12. 
13. 
I^. 
15. 
16. 
17. 
18. 

19. 
20. 
21. 
22. 
23. 



Allegheny Community 
Col lege 

A 6 P WEO 
Arco Gas 
Baker's Dairy 
Banksvi lie Sunoco 
Beacon Pharmacy 
Bel I Telephone 



Berman's Market 
Big Daddy Spats 

Bi-Rite Oil Company 
Boykin's Restaurant 
Catholic Cemeteries Assn. 
Cavert Wire Co. 
Centre Bui Iders 
Cox Steel Rule & Die Co. 
Crossroads Restaurant 
Dean Electronics 
Diamond Carbon Company 
Diamond's 5 & 10 
Dickson Brothers Cleaners 
Dormdt^t Gulf Station 
Dottle's Market 
Drapery World 



I 

2 
I 
I 
I 

6 



2 
3 



2^. Drapes & Things 



Audio-Visual Assistant 

Stock 

Attendant 

Counter clerk 

Attendant 

Del ivery S s tock 

1 - D I rectory 

2 - Grafting - 

Engineer I ng 

1 - Marketing 

2 - Framing men 
Sales & stock 
Counter work 
Attendant 
Cook's helper 
Landscape & masonry , 
Book packaging 

Sales £ stock 
Metal fabrication 
Bus boy 

Sales S apprentice * 
Production work 
Sales & stock 
Cleaning 
Attendant 
Sales 6 stock 
Sales £ drapery instal- 
lation 

Sales fi drapery instal- 
lation 
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COMPANY NUMBER OF STUDENTS TYPE OF TRAINING 



25. 


East Liberty American Gas 


1 


Attendant 


26. 


Falcon Service Station 


1 


Attendant 


27. 


Fischer Carpet Company 


1 


Carpentry helper 


28. 


Food land Grocery 


3 


Stock 


29. 


Frank! in Complex 


1 


Janitor 


30. 


Fred's Boron Station 


1 


Attendant 


31. 


Friend's Exxon 


2 


Attendant 


32. 


General Analytics 


1 


Surveyor's Assistant 


33. 


George Aiken Restaurant 


1 


Counter girl 


34. 


Gil's Department Store 


1 


Stock 


35. 


Gimbels Department Store 


2 


Sales & stock 


36. 


Heads Together 


1 


Maintenance 


37. 


Home for Crippled Children 


3 


Ch i Id care 




^Special Service 


1 






(Psychological testing and 


rehabll itatlon; 


Job exploration while In 




residence at the home as a 


patient.) 




38. 


John Heineman Company 


1 


Loading dock 


39. 


Johnson Florist 


1 


Del Ivery 


ho. 


Kelson's Restaurant 


1 


Bus boy 


M. 


Ken's American Gas 


1 


Attendant 


42o 


Key's Arco Gas 


2 


Attendants 


43. 


KQV Radio 


1 


Office Skills 


44. 


Krogers 


3 


Check out trainee S 








stock 


45. 


Lifster S Sons 


1 


C leri cal 


46. 


Love's Boron Station 


1 


Attendant 


47. 


ftark Lumber Company 


1 


Stock 
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COMPANY 



NUMBER OF STUDENTS 



TYPE OF TRAINING 



^8. Mason's Auto Repair 

^9. Jas. H. Matthews & Company 

50. McBeth Landscaping 

51. McCrory's Department Store 

52. McDonald's Restaurant 

53. * McMillan & Baer 

54« Melwood Leader Drugs 

55. Metropolitan Day Care Center 



56. Meyer's Exxon I 

57. National Record Mart 6 

58. Northern Communities 2 
Mental Health & Mehtal 
Retardation Services 

59. Northern Light Company I 

60. Opus One I 

61. Penn Overalls & Supply Co. I 

62. Pg. Commercial Heat Treating I 
Company 

63. Pgh. Glove Company 3 
6^. Pittsburgh Office Products I 

65. Phillip's Exxon Station 1 

66. Pizza Parlor I 

67. Post Office 3 

68. Sandy's Restaurant k 

69. Gene Sane's Upholstering Co. 2 

70. Sears, East Liberty 2 

71. Shealey's Sunoco I 

72. Specialty Clothing I 



Mechanic's helper 
Printing assistants 
Landscapi ng 
Sales 

Counter work 
Car Jockey 
Stock 

Child care S development 
Attendant 
Sales & stock 
Typing S f i 1 i ng 

Clerical & stock 
Sales 

Uniform Fabrication 
Apprentice 

Glove Manufacturing 

Clerk Typist 

Auto wash 

Counter work 

Postal worker trainees 

Kitchen Helper S 
Counter work 

Upholstering apprentice 

Sales S stocking 

Attendant 

Stock 
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COMPANY 



NUMBER OF STUDENTS 



TYPE OF TRAINING 



73. Simon's Pharmacy 1 

,7^. Stillwagon's Sunoco 1 

75. Stuckert's Exxon 1 

76. Sweet Wi 11 fams Restaurant k 

77. Tambelllni's Restaurant 1 

78. Thorofare Market 1 

79. Toe Con Furniture 1 

80. Thrift Drugs 1 

81 . Trenton Oaf ry 1 

82. Typecraft Press Inc. 1 

83. Turner's Exxon 1 
8^. United Parcel Service 1 

85. Urban Improvement & ] 
Development Corp. 

86. Urban Youth Action 1 

87. Veterans Administration 2 
Hospital 

88. Vilish Gulf Station 1 

89. WAM-TV ; 

90. Wheeler Paints 1 

91 . White Tower ' 7 

92. Winkys Restaurant 3 

93. World Surplus 1 
Sk. WRS Motion Picture Lab 1 



Sales & stock 

Attendant 

Attendant 

Counter work & kitchen 
he 1 pe r 

Bus boy 

Stock 

Tube tester 
Stock 

Del icatessen sales 
Printer's helper 
Attendant 
Loading dock 
Construct ion 

Clerical 

1 - Clerk typist, 
Med. Ad. Division 
1- Painter's helper, 
Eng. 

Attendant 

Customer service & 
Clerical 

Sales 6 stock 

Short order cooks 

Food preparation 

Stock 

Fl Im processing 



TOTAL 



155 
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a> Students* Attitude . A sample of kk students enrolled In Project 
SET was selected by the Project Coordinator to complete questionnaires 
during one of their regular meetings. To insure anonymity, the completed 
questionnaires were returned in a sealed envelope to the project director 
who then mailed them directly to AIR. -AM students completed question- 
naires. Overall, the students again responded positively to the work 
experience program. 

Students Indicated aspects of the program which they liked best. 
For example, seven students stated they liked not only the credit they 
received for working but an opportunity to earn money. Four students enjoyed 
meeting people and the work they did. Others commented about a variety of 
positive program features—the program allows for failures and provides 
occasions to Improve skills. It also supplies a chance to learn about 
business operations, gain work experience, and assume a sense of responsi- 
bility. Students seemed to en )oy the exposure to the bus! ness^'wor Id , not 
only in terms of relating to other people, but learning about new jobs. 
A few appreciated the potential follow-on for employment after graduation. 

Nineteen students responded that there was nothing which they 
liked least about the program. Some students cited causes for minor dis- 
satisfaction, such as minimum hours and low salary, specific days set aside 
for work, no increase In salary, working and attending school, and no early 
dismissal from school. 

Regarding attitude change toward work, ten students said their 
attitude had remained unchanged. The remainder of the students stated they 
began to realize greater personal satisfaction, they learned the value and 
necessity of a steady employment, they developed a desire to learn, and 
gained a sense of responsibility. These responses suggested that students 
are more motivated toward self-Improvement. 

Students who Indicated an attitude change toward school stated that 
they now began to realize the Importance of an education and the need to 
study harder, to be more mature, and to maintain good grades. Students 
acknowledged the assistance that the school supplied in securing a job. 
Seventeen students cited no change In attitude had occurred. 
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Twenty-five students Indicated they would make no program changes. 
Those students suggesting changes cited the need for additional work hours, 
more jobs, additional credits, salary Increases, mandatory school attendance, 
and greater exposure among the students. Students seemed to want others to 
have the opportunity to also participate In this program. 

b. Employers' Attitude. The Project SET Coordinator supplied AIR with 
a Hst of 55 employers with whom SET students In the cooperative work 
experience program are currently or were previously affiliated. Question- 
naires were sent to the 55 employers who returned them directly to AIR. Of 
the 55 questionnaires mailed, lA (about ZS%) were received by AIR. 

Employers Indicated aspects with which they were satisfied of 
the SET students current work performance. These aspects Included positive 
attitudes toward work, willingness to learn, and high quality of 
work performance. Employers stated their SET students showed responsibility, 
dependability, and capability. Thirteen employers felt that SET students 
demonstrated Improvement In their work performance during their period of 
employment. Some ways In which students Improved were that students gained 
more confidence In their ability to do their work, they were more alert, and 
able to assume additional responsibility without assistance. Students 
improved In the performance of theKr^ jobs and worked quickly and efficiently. 
Some employers felt that Improvement was due to ongoing supervision and the 
fact that the students worked directly with experienced people. Others 
stated that students Improved as they obtained a working knowledge of the 
bus Iness . 

There were seven positive responses and six negative responses as 
to whether the student was adequately prepared to assume job responsibilities 
when he or she Initially joined a company. Positive responses related to 
preparation Included dependability, pleasing personalities, good work 
attendance, and capability. One employer Indicated that the student readi- 
ness was due to the orientation received In school. Negative responses 
related to preparation for employment Included lack of employmejit training, 
lack of experience working with the public, and lack of loyalty to the job. 
Two employers stated that the capability of their two student employees was 
lower than they had expected^ 
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Employers were asked If the contact between them and the school 
had been sufficient to solve any difficulties which arose during the 
student's employment. Only one negative comment was received; this employer 
stated that the student's needs were primarily emotional and went beyond 
those which the school was capable of satisfactorily meeting. Most employers 
indicated that when the Initial contacts were made between the school and the 
business, the limitations or problems encountered by the student were iden- 
tified by the school for the employer In order to avoid any misconception on 
the part of the employer. Employers were appreciative of this candid 
approach. 

Each employer was asked whether he or she would be willing to hire 
their student employees as full-time employees following graduation. All 
but four answered affirmatively; negative responses did not necessarily 
indicate dissatisfaction with students* work performance but reflected 
other factors which entered Into the decision of whether or not to hire 
permanently. For example, one employer Is prevented from hiring a student 
because of union requirements that full-time employment must be based on 
seniority and length of service with the company. Another employer stated 
that the only positions available required more extensive training than the 
student was able to gain during his period of employment. Some employers 
stated that if their students would remain on the payroll. It may be on 
a part'-time basis. Overall, most employers who were satisfied with the job 
performance of their student employees were willing, If possible, to hire 
the student as a full-time employee. 

None of the employers who responded to the questionnaire suggested 
any changes in the program. They seemed pleased with the ongoing procedures. 
Additional comments by the empjoyers were generally favorable. One employer 
acknowledged the mutual benefit between employer and student derived from 
such a program. 

Again, the general employer response to participation In Project SET 
was favorable. As with the 1972 evaluation, the employers offered some 
anecdotal Information which indicated a positive feeling about the program. 
The goal of Project SET to demonstrate that the private sector and the 
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school system can effectively coordinate efforts to provide alienated youth 
with meaningful counseling and career exploration and training experiences 
seems to have been met . 

c. SET Placements 

Table 31 on the following page shows the number of students placed In 
occupational situations as of November 1973. Placement refers to those 
students employed In their first Job; re-placement refers to those students 
who, For whatever reasons, received placement In a job other than their 
original one. 
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Table 31 
Placement Program 



Allderdlce 

Allegheny 

Carrick 

Fifth Avenue 

Gladstone 

Lang 1 ey 

Oliver 

Peabody 

Perry 

Schenley 

South 

South Hills 
West inghouse 

Totals 



Placement 



Re-Placement 



M 
10 

1 

7 

\k 
3 

I'l 
13 

2 

15 
16 

8 
7 



£ 
1 

2 
2 



5 



0 
2 
3 

10 
1 

li 
2 
A 



158 AO 



M 
0 

5 

0 

0 

0 

0 

1 

6 

0 

0 

0 

2 

_0 

I'l 



F 
0 

1 

0 

0 

0 

0 

0 

0 

I 

0 
0 
0 

0 
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d. Case Studies ^ Project SET Is a unique program which was designed 
to handle unique problems. Examples of the range, abilities, problems, and 
situations with which the SET staff members worked are described below. 
These examples provide some familiarization with the scope of work and 
type of approach used within the SET program. 



I : Case^Stud' 




AGE: 16 
GRADE: 10 

GRADE POINT AVERAGE: 1.8 
ABSENCE: U7 days (1971-1972) 
COOPERATING SCHOOL PERSONNEL: 

Area 1 Office 

Vice Principals (2 schools) 

Counselors (2 schools) 

Typing Instructor 

Engl ish Instructor 

Phys i ca 1 Ed uca t i on I ns t rue tor 

History Instructor 

SPECIAL PROBLEM: Student was enrolled at Allegheny, 
but schedule was not flexible enough to allow student 
to leave school in time to work. Also, classes were not 
offered which would assist student on the Job. 

SPECIAL ACCOMMODATION: A SET staff member arranged for 
student to attend Perry where student was able to receive 
the desired and necessary classes. Student was also 
able to leave school in time to attend work. This was, 
of course, done with parental permission. They were 
relieved because before the transfer, student tried moving 
closer to the job by living with a brother and then a 
sister causing a large degree of family turmoil. As of 
today, the transfer and Job are very successful. 
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Case Study 

AGE: 16 
GRADE: 10 

GRADE POINT AVERAGE: .08 
ABSENCE: 42 days (1971-1972) 
COOPERATING SCHOOL PERSONNEL: 

Vice Principal 
Counselor 

Printing Instructor 
Study Instructor 

SPECIAL PROBLEM: Student was one of the most 
difficult students to place. Once we found a 
job for him, he was ecstatic, but the employer 
complained because he was five to ten minutes late 
each day. An investigation disclosed that his 
last class involved a "clean up'' period and the 
instructor kept him until the work was done. 

SPECIAL ACCOMMODATION: A SET staff member arranged 
with the Cooperating School Personnel above to 
exchange the last class with a second period study. 
The printing instructor was especially accommodating 
due to an overload in the class. The vice principal 
provided a special pass allowing him to leave 
school 15 minutes early. As of the present date, 
student displays a successful record on a job that 
six other students were released from In 2 months. 
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ill: Case Study 



AGE: 18 
GRADE: 12 

GRADE POINT AVERAGE: K2 
ABSENCE: 63 days (1971-1972) 
COOPERATING SCHOOL PERSONNEL: 

School Nurse 
Counselor 

Physical Education Instructor 

SPECIAL PROBLEM: Student has had extreme emotional 
problems due to a skin disease and harassment 
during her physical education class. As a result, 
she was placed in an Adaptive Physical Education 
class, which ended at 1:^5 P.M. She was considered 
for a job, but the employer Insisted that the 
student be on the Job at 12:00 P.M. The SET staff 
took a "gamble'* that there was the possibility If 
the employer was pleased with student's performance, 
he would give her the opportunity to work. 

SPECIAL ACCOMMODATION: The SET staff members solicited 
the assistance of the Physical Education Instructor 
mentioned above. It was agreed that student would be 
excused for two weeks, which would allow her to 
become oriented to the job* During this time, our 
staff member requested the employer to change 
student's work hours or she would not graduate. 
He complied, and she Is now attending her last 
period class regularly and her job at 2:30 P.M. 
The "gamble" worked out well, but if the Cooperating 
School Personnel member would not have allowed 
student's release time, she would have never 
received the chance to prove herself. 
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Case Study 



AGE: 18 
GRADE: 10 

GRADE POINT AVERAGE: 1.2 
ABSENCE: 58 days (1971-1972) 
COOPERATING SCHOOL PERSONNEL: 

Counselor 

Home Room Instructor 

SPECIAL PROBLEM: Student presents a severe emotional 
problem* His mother Is an out-patient at St. Francis 
Psychiatric Hospital and becomes severely emotionally 
upset frequently. During the last incident when she 
became violent, she attempted to suffocate a younger 
child and set fire to the home after destroying many 
objects In It. Student also displays effeminate 
characteristics. He Is constantly harassed In school 
and ''hates'* school . 

SPECIAL ACCOMMODATIONS: There were two accommodations 
made for this student; they were: 

(a) Student displayed emphatically to me that he 
could only remain In school one more year. In order 
to graduate In that time, he had to enroll in summer 
school for advanced English* His grades were atrocious 
and he was not accepted for the advanced class. This 
was very upsetting to the student, so we discovered 
one counselor who would sign his summer school card. 
This counselor took part of the responsibility for 
referring this student to summer school; usually the 
students In this advanced English class are A and B 
students. To our amazement, student made an A. There 
were three reasons: (1) the students were from other 
schools and did not know him; (2) he was tutored by a 
staff member; and (3) his determination to finish 
school In one year . 

(B) As mentioned before, the last disturbance of 
student's mother was extremely dangerous. Student 
had to be home to '^protect" the younger children. He 
missed seven weeks of school. His home room Instruc- 
tor and a SET staff member arranged with all of the 
student's teachers to pick up dally assignments and 
administer tests at home. The home room Instructor 
did this for the entire time that student was 
absent. He Is now back In school and passing each 
class* 




v: Case Study 



AGE: 19 
GRADE: 10 

GRADE POINT AVERAGE: 0.0 
ABSENCE: 95 days (1971-1972) 
COOPERATING SCHOOL PERSONNEL: 

Area 1 Office 
Pri ncipal 
Counselor 

SPECIAL PROBLEM: Student was given the opportunity 
to work at Lavelle Realty. After working for two 
weeks, he was suspended from school for the second 
time in two months. This time, readmitting him 
seemed out of the question. Student attended 
Allegheny In the morning for OVT Cabinetry Shop, 
and his base school was Perry where he attended 
school in the afternoon. He couid not return to 
school . 

SPECIAL ACCOMMODATION: Area 1 office allowed us to 
set up tutoring sessions at our SET office. We 
would assign homework and test him In English, 
Mathematics, and U. S. History. We were given 
permission to grade him, these grades given the same 
weight as regular school grades. Our obligation 
was to turn in a curriculum to Area 1 Office and 
carry out all regular teaching duties. Also, the 
principal at Allegheny allowed student to remain 
In school since no Infraction occurred at that 
school. This was all successfully carried out for 
three months, but the final results were not as 
anticipated. Student quit the job and school to 
enter the service. It Is Important to recognize 
that every effort was made by the Cooperating 
School Personnel members, although there was no 
lasting success. 
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The case studies cited below focus more specifically on the nature 
of alienation Project SET students possessed. Reports of the type illus- 
trated below existed for all students enrolled in Project SET. 



AGE: 18 
GRADE: 9 

Psychological rehabilitation and evaluation was being 
conducted under the Bureau of Vocational Rehabilitation. 

ALIENATION INFORMATION: 

2-1/2 years attendance at high school with 2 credits 

completed. 

Large family without father. 

On Public Assistance. 

Educable Mentally Retarded, 

Sister is homosexual and attempted to have her join 

her "group. 

"Group** physically attacked her, she reacted extremely 

fearfully and became very disturbed. 

Center of much ridicule at school and in the commun- 
ity. 

One of three most alienated students at the school 

she attended^ 

PRESENT STATUS: 

After six months of psychological rehabilitation 

and our counseling and supportive aid, she now has 
a desire to wash and take care of herself physically. 
She has also been given diagnostic evaluation and 
Is to report to Johnstown Rehabilitation Center. 
Johnstown is a residential center for rehabilitation 
training. We are now counseling toward adjustment 
to the center. This effort is the culmination of 
an entire year of joint effort between the SET/VEPS 
staff and Liaison team. 
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AGE: 17 
GRADE:. II 

TYPE OF TRAINING: Clerical 



ALIENATION INFORMATION: 

On Public Assistance, 

Had an illegitimate child who has since passed away. 

This has created extreme emotional upset and confusion 

....•As a possible escape or substitution, she has accep- 
ted many babysitting jobs. This was considered 
reasonable by the staff until it became an extreme. 
She began missing school and work. She had a child 
accompany her to the work site, since then she was 
termi nated. 

After much discussion and literal begging by the staff 

she was accepted back to her job. Attendance at 
school and work became so poor that all was lost. 

PRESENT STATUS: 

She was fired and is presently employed part-time 

but refuses to return to school. Our only alternative 
has been to convince her to acquire a General 
Equivalency Diploma on which she is now working. 
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AGE: 19 

GRADE: Graduated from school 

TYPE OF TRAINING: Plumber's assistant and counter sales 

work. 

ALIENATION INFORMATION: 

Extrememly introverted personal ity, 

Grade Point Average 1.3 (11th grade). 

Absence ^1 days (11th grade). 

Projects hostile attitude. 

His answer to most questions is, "I don't care." 

••...Slow In acquiring information. 

PRESENT STATUS: 

As stated, 9th, 10th, and 11th grade revealed 

poor attendance and a "D" average. After he was 
placed on this Job and warned about attendance 
and grades, he achieved a 2.8 - 12th grade average 
carrying a solid academic level and only 11 days 
absent. He has now graduated and Is still employ- 
ed after a year and a half with a $1.00 an hour 
raise. He remains as one of our most successful 
experiences. 
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SELECTED FUNCTIONAL COMPONENTS OF A VOCATIONAL EDUCATION COUNSELING SYSTEM 

FOR URBAN YOUTH 



Sponsor: Pittsburgh Board 
of Education 
341 South Bellefield Ave* 
Pittsburgh, Penna, 15213 



Evaluation Instruments Prepared by: 
American Institutes for Research 
710 Chatham Center Office Building 
Pittsburgh, Penna, 15219 



Student Questionnaire 
Career Orientation - Phase 



DIRECTIONS: 



Circle the number which tells how you feel about the 
following statements. 



K I enjoyed the activities in 
OVT. 

2, I learned how to get along 
wt th other people. 

3. I learned some things about 
myself, 

k. I learned about what people 
do in some jobs. 

5. I enjoyed helping other people 
do the! r work. 

6. I enjoyed making things in OVT. 

7. I enjoyed working with other 
people. 



A^ ree 
3 
3 

3 
3 

3 

3 



Undeci ded 
2 
2 
2 



Disagree 



2 
2 



Name 



Sex ( I ) 



Male 



(2) 



School 
Female 
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Parents' Questionnaire - Phase I and Phase It 
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SELECTED FUNCTIONAL COMPONENTS OF A VOCATIONAL EDUCATION COUNSELING SYSTEM 



FOR URBAN YOUTH 

Sponsor: Pittsburgh Board Evaluation Instruments Prepared by: 

of Education American Institutes for Research 

3A1 South Bellefleld Ave* 710 Chatham Center Office Building 
Pittsburgh, Penna. 15213 Pittsburgh, Pennsylvania 15219 

OVT Career Orientation Program 

Parents' Questionnaire 

!. How do you feel about your son's or daughter's participation In the OVT 
Exploratory Program? 



2. Does your son or daughter talk about OVT at home? Yes No 

If yes, what does he or she say about the program? 



3. Does your son or daughter talk about the relationship between OVT acti- 
vities and occupational opportunities? Yes No If yes, what 

does he or she say about them? 



In what way do you think the OVT Exploratory Program has been most 
helpful to your son or daughter? 



5» In what way do you think the OVT Exploratory Program has been' least 
helpful to your son or daughter? 



6» What changes would you suggest to Improve the OVT Exploratory Program? 



7. In which OVT Exploratory Program does your son or daughter participate? 

Number of chl Idren 
Phase I (6th grade) 

Phase I I (7th grade) 
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SELECTED FUNCTIONAL COMPONENTS OF A VOCATIONAL EDUCATION COUNSELING SYSTEM 

FOR URBAN YOUTH 



Sponsor: Pittsburgh Board 
of Education 
3M South Bel lef leld Ave* 
Pittsburgh, Penna. 15213 



Evaluation Instruments Prepared by: 
American Institutes for Research 
710 Chatham Center Office Building 
Pittsburgh, Penna. 15219 



Student Questionnaire 
Career Orientation - Phase II 



Name 



Sex (1) 



OVT School 



Male 



(1) 
(2) 



(2) ^ 
South Side 
\/ashinaton 



Home School 

Female 

(3) Arsenal 

W Oliver 



McNaugher 



1. Circle the number which represents your opinion of what you learned 
about the world of work in Business Education: 



a« I enjoyed the activities in 
this area. 

I learned about the kinds 
of jobs available in this 
field. 

c* I learned about what kinds 
of tasks people perform in 
various jobs* 

d« I know what additional 
schooling Is needed for 
various jobs in Bus 1 ness 
Education . 

e* I learned enough to make a 
decision about whether I am 
interested in learning more 
about Business Education 
next year in OVT. 



Aqree 



It was OK Disanree 
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2. Circle the number which represents your opinion of what you learned 
about the world of work in Home Econanics: 



a. I enjoyed the activities in 
this area. 

b. I learned about the kinds 
of jobs available in this 
fields 

c* I learned about what kinds 
of tasks people perform in 
various jobs, 

d. I know what additional 
schooling is needed for 
various jobs in Home 
Economics ♦ 

e. I learned enough to make a 
decision about whether I am 
interested In learning more 
about Home Econom i cs next 
year in OVT. 



Agree It was OK Disagree 
3 2 ] 

3 2 1 

3 2 1 

3 2 ] 

3 2 1 



3. Circle the number which represents your opinion of what you learned 
about the world of work in Industrial Arts. 



a< I enjoyed the activities in 
this area. 

b. I learned about the kinds 
of jobs available In this 
field. 

c. I learned about what kinds 
of tasks people perform In 
various jobs In I ndus trial 
Arts . 

e. I learned enough to make a 
decision about whether I am 
interested in learning more 
about Industrial Arts next 
year In OVT. 



Agree It was OK Disagree 



A. Circle the number that expresses your opinion about whether this year's 
OVT activities will help you choose the four subject areas you v/ould 
like to participate in next year In OVT. 

1 It helped a lot 2 It helped a little It didn't help 

lis 
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SELECTED FUNCTIONAL COMPONENTS OF A VOCATIONAL EDUCATION COUNSELING SYSTEM 

FOR URBAN YOUTH 



Sponsor: Pittsburgh Board 
of Education 
3^1 South Bellefield Ave* 
Pittsburgh, Penna. I52I3 



Evaluation Instruments Prepared by: 
American Institutes for Research 
710 Chatham Center Office Building 
Pittsburgh, Penna* 15219 



Student Questionnaire 
Career Orientation - Phase 



Name 

Sex (1) 
OVT School 



"Home School 



Male (2) 

(1) South Side 

(2) Washington 



Female 

(3) Arsenal 



(5) 



McNaugher 



01 Iver 



Circle the number which represents your opinion of what you learned 
about the world of work in Business Education: 



I enjoyed the activities in 
this area* 

I learned about the kinds of 
jobs available in this field. 

I learned about what kinds of 
tasks people perform in vari- 
ous jobs. 

I know what additional school- 
ing is needed for various jobs 
In Business Education. 



Ag ree 
3 
3 



It was OK 
2 
2 



Pi sag ree 
I 
I 
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2. Circle the number which represents your opinion of what you learned 
about the world of work in Home Economics : 

Ag ree It was OK Pi sagree 

a* I enjoyed the activities in 

'this area. 3 2 1 

b. I learned about the kinds of 

Jobs available in this field* 3 2 1 

c. I learned about the kinds of 
tasks people perform in vari- 
ous Jobs. 3 2 1 

d. I know what additional school- 
ing is needed for various Jobs 

in Home Economics. 3 2 1 



3* Circle the number which represents your opinion of what you learned 
about the world of work in Industrial Arts : 

Agree It was OK Pi sagree 

a. I enjoyed the activities in 

this area. 3 2 1 

b, I learned about the kinds of 

Jobs available in this field. 3 2 1 

c, I learned about the kinds of 
tasks people perform In vari- 
ous Jobs. 3 2 1 

d. I know what additional school- 
ing is needed for various Jobs 

i n Industrial Arts . 3 2 1 

» 

5» Circle the number that expresses your opinion about v/hether OVT has 
helped you choose your course of study next year. 

3^ It helped a lot 2^ It helped a little It didn't help 
6. How has OVT been the most helpful to you? ^ 



7. How has OVT been the least helpful to you? 
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Student Achievement Test 



DIRECTIONS: You have been selected to help the teachers make changes fn next 
year's OVT program. These questions were designed to find out how much you 
learned; your answers will be used to decide what changes need to be made. 
You will not receive a grade on this test. 

Please circle one answer to each of the following items. 
CLOTHING AND TEXTILES 

1. The first thing to do before selecting a pattern is: 

a. select the fabric 

b. pick your accessories 

c. take your nieasurements 

d. select correct pattern size 

2. Which of the following is not a stitched product? 

a. embroidered wal 1 hanging 

b. needlepoint chair cover 
^. tie-dye scarf 

d.. qui 1 ted pi 1 low 

3. Which of the following pattern markings shows the straight of the 
fabric (selvage)? 

a* b. /V\ c. /V^VA 

4. A person who sews clothing Is called a: 
a. pattern maker b. retailer c. cutter 

5. What job in the clothing and textiles industry usually needs additional 
training beyond high school? 

a. a cutter b. a fashion c. a machine d. all of 

des i gner operator these 



I. J 



d. seamstress 



HEALTH AND COMMUNITY SERVICES 

6. Which of the following careers requires the greatest amount of formal 
education? 

a. a nurses aide b. a registered c. an orderly d, a practical 

nurse nurse 

7. Which of the following activities is not performed by a lab technician? 

a. blood typing 

b. preparing bacteria cultures 

c. distributing medicine to hospital patients 

d. preparing microscope slides 
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8. Which of the following occupations requires knowledge of first aid techniques? 

a. a registered nurse b. a practical c. an ambulance d. all of the 

nurse attendant above 

9. A career In the health services field Is a(n): 

a» social studies b. lawyer c. engineer d. X-ray 

teacher technician 

10. Most people have a normal temperature of: 

a. 35.7 b. 100 c. 98.6 d. 75.8 

FOODS AND NUTRITION 

11. Which of the follcv/Ing terms best describes the process of mixing Ingredients 
which requires gently lifting the bottom of a mixture and raising to the top? 

a. creaming b. foldi ng c. kneading d. whi ppl ng 

12. The person who plans menus, supervises food preparation, and manages food 
service activities is a: 

a. waiter b. vegetable c. dietitian d. butcher 

cook 

13. The form of milk from which the water has been removed is: 

a. dried b. creamed c. homogeni zed d. skimmed 

14. Good nutrition primarily depends on: 

a. spending large amounts of money for food 

b. using convenience foods 

c. well-balanced meal planning 

d. low-cost meals 

15. Which of the following processes Is recorrmended for tenderizing cuts of 
meat? 

a. freezing b. grinding c. broiling d. frying 

MANUFACTURING 

16. In sheet metal work, patterns are: 

a. transferred directly to sheet by tracing 

b. drawn on sheet using pattern as a reference 

c. glued to sheet and cut around it 

d. not needed 
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17. The bending brake is used: 

a. to cut stock 

b. for all seams and forming operations 

c. for seams on ly 

d. for most seams and forming operations 

18. With which of the following materials is the vacuum former most commonly 
used? 



a. lead b. plastic 

19. When welding, the electrode is: 

a. the holder b. the flux 



c. tin f^B.te d. steel 



c. the welding d. the welding 
rod shield 



20. Which of the following list of careers in manufacturing requires a college 
degree? 



a. furnace 
Instal ler 



b. auto body 
mechanic 



c. mechanical 
engi neer 



d. pattern 
maker 



CONSTRUCTION 

21. Into /hich of the following two classes Is wood divided? 



a. light and dark 



b. thick and 
thin 



22. A brace and bit are used to: 

a. cut corners b. cut a miter 



c. hard and 
soft 



bore holes 



d. hot and 
cold 



d. all of the 
above 



23. Which of the following power machines \6 most similar to the coping saw? 

a. Sander b. drill press c. jig saw d. band saw 

2A. Which of the following hand tools are commonly used by a carpenter? 

a. woodburner, sandpaper, bench rule, coping saw 

b. chisel, c clamp, screwdriver, file card 

c. steel square, hammer, handsaw, plane Iron 

d. pattern, vise, file, dividers 

25. A mallet, try-square, and handsaw are tools most commonly used in which 
of the following shops? 

a. construction b. visual c. pov/er and d. manufacturing 

communication transportation 
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POWER AND TRANSPORTATION 



26. 



27. 



28* 



29. 



30. 



a microphone converts sound energy into: 

a. electrical mechanical 

energy 



c. 



heat 
energy 



energy 

An electric circuit consists of a: 

a. battery, pilot lamp, and alhultlmeter 

b, resistor, switch, energy 

c. voltage source, a load, and a complete path for current 

d, hookup wire, multimeter, pilot lamp 

Which of the following careers requires a college degree? 
a. television b, electri clan c, electrical 



repai rman 

A volt meter is used to measure: 
a. electrical b* 



electri cal 
resistance 



electrical 
current 



c. 



engineer 



electrical 
pressure 



Which of the following people repairs electrical appliances? 

a» an electrical b« a television c« 

repairman 



an electrica 
engineer 



an appliance 
repairman 



d* chemical 
energy 



d« auto 

mechanic 



electrical 
power 



d* an 

electrician 



VISUAL COMMUNICATIONS 

3K On which of the following printing devices Is a linoleum block used? 



a* off-set 
dupl Icator 



b, platen press c, engraving d, none of 

machine these 



32« Which of the following is used to cut a film for s I Ikscreenlng? 
a. pen knife b, sloyd knife c. exacto knife 



d. razor 
blade 



33. When setting type, which of the following Is used to check for errors? 



a. platen press 



b» proof press c, engravograph 



d, off-set 
dupl Icator 



3^» After a silkscreen design Is finished, place the Ulano material 

a. under the design v 

b. on top of the design with wax side up 

c. on top of the design with wax side down 
d« away from the design 
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35. Which of the following career opportunities is not related to visual 
coimiun i cat ions? 

a. design b. drafting c. commercial d. legal 

art secretary 

MERCHANDISING 

36. A good method of determining whether or not a new product will sell is: 

a. reading a book 

b. conducting a market survey 

c. trimming a showcase 

d. mai ling letters 

37. The selling price of a product should include: 

a. cost 

b. cost and expenses 

c. costj expenses^ and profit 

d. cost and profit 

38. Which one of the following jobs is not directly related to merchandising? 

a. buyer b, inventory c. carpenter d. sales 

clerk person 

39. Which of the following individuals is involved in the merchandising 
process? 

a. buyer b. salesperson c. inventory d. all of 

clerk these 

^0. If an accountant depressed a "plus" key after each ninber he entered on 
a calculator, then depressed the "total** key^ he would be: 

a. adding b. subtracting c. multiplying d. dividing 



BUSINESS COMMUNICATIONS 

^I. A stylus is used for: 

a. writing a business letter 

b. repairing typewriters 

c. cutting a stenci I 

d. drawing Illustrations 
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^2. When applying for a job> the letter of application should be accompanied by: 

a. a resume, or data sheet 

b. an envelope with your return address 

c. a carbon copy of the letter 

d. al 1 of the above 

^3. The federal government requires that each worker have a: 

a. time card b. social ^ ^ c. personal d. high school 

security card data sheet diploma 

^k. Which of the following kinds of Information should not^ be Included on a 
personal data sheet? 

3» name b, address c. educatlonel d. religion 

background 

Which of the following occupations requires a college education? 

a. secretary b. file clerk c. accountant d. receptionist 

INFORMATION PROCESSING 

^6. The following names appear on a payroll register. Which grouping Is not 
In correct alphabetical order on this list? 

a. Clark, Clarke, Clarkson, Clarkton 

b. David, Davidson, Davis, Davison 

c. Brown, Browne, Browning, Bronner 

^7* A reference Is a(n): 

a. recommendation b. list of c. application d. all of the 

employees above 

^8. Which of the following people would probably not work with computers? 

a. da ta processor b, keypunch c. lab d . compute r 

operator technician programmer 

^9. A personnel Interviewer should be acquainted with all but one of the 
fol lowing: 

a, company products and services 

b, jobs available In a company 

c, company hiring practices 

d, number of children In employee's family 

50» When a punched card Is used for recording Information, the data on the 
card are represented by: 

a. printed captions b. magnetized c. punched holes d. none of 

spots these 
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SELECTED FUNCTIONAL COMPONENTS OF A VOCATIONAL EDUCATION COUNSELING SYSTEM 

FOR URBAN YOUTH 



Sponsor: Pittsburgh Board 
of Education 
3^1 South Bellefield Ave. 
Pittsburgh, Penna. 15213 



Evaluation Instruments Prepared by: 
American Institutes for Research 
710 Chatham Center Office Building 
Pittsburgh, Penna. 15219 



Project SET 
Student Questionnaire 

1. What do you like best about the work experience program? 



2. What do you like least about the work experience program? 



3» How has the work experience program changed your feelings about work? 



A. How has the work experience proaram chanqed your feelings about school? 



5* If you were running this program, what changes would you make? 



6. Other (Please add any additional comments you would like to make about 
the work experience program.) 
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APPENDIX G 
Employer Questionnaire ^ Project SET 
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SELECTED FUNCTIONAL COMPONENTS OF A VOCATIONAL EDUCATION COUNSELING SYSTEM 

FOR URBAN YOUTH 



Sponsor: Pittsburgh Board Evaluation Instruments prepared by; 

of Education American Institutes for Research 

3^1 South Belief leld Avenue 710 Chatham Center Office Building 

Pittsburgh, Penna. 15213 Pittsburgh, Penna- 15219 

Project SET 
Employer Questionnaire 

U Are you satisfied with your Project SET student's current work perfor- 
mance? Please explain: 



2. Has this student Improved during the period of employment? 
Yes No Hew? 



3* Do you think the student was adequately prepared to assume Job respon- 
slbllltles? Yes No PI ease expla In : 



Do you think the contact between you and the school has been sufficient 

to solve any difficulties that have arisen? Yes No Please 

explain: 



Would you consider hiring this student as a full-time employee after 
graduation? Yes No Please explain: 



6. Have you any suggestions for program changes which would better serve 
your needs? 



7. Other (Have you any additional comments about any part of the work experi- 
ence program?) 



6/73 
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APPENDIX H 
Student Questionnaire - COOP 
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SELECTED FUNCTIONAL COMPONENTS OF A VOCATIONAL EDUCATION COUNSELING SYSTEM 

FOR URBAN YOUTH 



Sponsor: Pittsburgh Board Evaluation Instruments Prepared by: 

of Education American Institutes for Research 

3^1 South Belief ield Ave. 710 Chatham Center Office Building 

Pittsburgh, Penna. 15213 Pittsburgh, Penna. I52I9 



Cooperative Work Experience Program 
Student Questionnaire 

1. How was your first contact with the Cooperative Work Experience 
coordinator made? 



2. When was this contact made? What did you discuss? 



3. How did the coordinator assist you in selecting a satisfactory 
cooperative work experience? 



During this school year, approximately how many times did you ask 
to meet with the coordinator? 



Of this number, how many times did you actually meet with the 
coordinator? 

How many times did the coordinator ask to meet with you? 



5. How were you advised about employers' expectations regarding your 
appearance, work habits, attendance or general behavior before you 
started ycyjr work experience? 
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6. Why did you choose your particular ski I] area? 



7. Does your cooperative work experience match your skill training? 
Please explain. 



8. What are your career plans following graduation? 



9. What factors affected your decision? 



10. If you were directing the work experience program, what changes 
would you make? 
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Employer's Questionnaire - COOP 
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Employer's Questionnaire (COOP) 



The purpose of this questtonnaire is to ask your general opinion regarding the adequacy of vocational 
training, as reflected in the job performance of Pittsburgh Public School graduates withtn your employ Your 
objective response to these items wtll help insure that Occupational and Vocational Training (OVT) programs 
remain responsive to your needs. * 

1. Employer Identification 

Name of Organization 

Type of Operation 

Number of Employees at this Site 

Total Number of Employees in Company 



For what types of employment have you hired OVT graduates (check as many as apply) 

Secretarial, clerical Maintenance 

Labor Cosmetology 

Skilled trade Transportation 

Medical, dental, lab assistant Data Processing 

Food Services Other (explain)^ 

Sales 

Bank services 



3, The OVT graduates that I employ are doing an adequate job, (Circle the appropriate number) 

1 2 ' 3 ^ 4 5 

Strongly Disagree Neither Agree Agree Strongly 

Disagree Nor Disagree Agree 

4, Relative to other new employees, how much orientation and training is required before the OVT 
graduates can perform the job satisfactorily? (Circle the appropriate number) 

1 Less orientation 

2 About the same 

3 More orientation 

5. Relative to other new employees, how would you rate the performance of OVT graduates? (Circle the 
appropriate number) 

1 Above average 

2 Average 

3 Below average 

6. What major problems have you had with OVT graduates? 
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Based on your experience with OVT graduates, rate their attendance, attitude toward co-workers, and 
attitude toward supervisors by circling the appropriate rating for each of the behaviors indicated in the 
chart below. 
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Rating 










Attendance 


Attitude Toward 
Co-Workers 


Attitude Toward 
Supervisors 


Excellent 


4 


4 


4 


Acceptable 


3 


3 


3 


Below Average 


2 


2 


2 


Unacceptable 


1 


1 


1 



8 Training received by OVT graduates has been braod enough to allow them to transfer between jobs 
requiring moderately different skills. (Circle the appropriate number) 



1 

Strongly 
Disagree 



2 

Disagree 



Neither Agree 
Nor Disagree 



9. OVT graduates are highly promotable. (Circle the appropriate number) 



1 

Strongly 
Disagree 



2 

Disagree 



Neither Agree 
Nor Disagree 



4 

Agree 



4 

Agree 



5 

Strongly 
Agree 



5 

Strongly 
Agree 



10, When you are in need of employees, there are a number of sources that you might utilize. For the 
sources listed below, indicate your first, second, and third preference by placing the number 1, 2, or 3 
before the source. 

> Private employment agency 

State employment agency 

v ' Your own employment office files 

• ' > Relatives, friends or acquaintances of present employees 

' / ^ Public school sources (guidance counselors, vocational coordinators, etc.) 

1 * Other (please specify) 



11, Do you have, or have you ever had, a COOP (Cooperative Work Study Program) student in your 
employ? (Circle the appropriate response) 

1 Yes 2 No 

If yes : a. How many of these students have you had in your employ? 



Of this number, how many continued in your employ after graduation?. 



12, These COOP students were sufficiently prepared to make a positive contribution to my operation. 
(Circle the appropriate number) 



1 

Strongly 
Disagree 



2 

Disagree 



Neither Agree 
Nor Disagree 



4 

Agree 



5 

Strongly 
Agree 



Questionnaire prepared by American Institutes for Research, Pittsburgh, Pa. 
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